-- Logs begin at Wed 2022-07-20 21:08:30 UTC, end at Wed 2022-07-20 22:18:23 UTC. -- Jul 20 21:43:39.515403 dv-cinder-849690-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 21:43:39.524098 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 21:43:39 2022] *** Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: nodename: dv-cinder-849690-5-iscsi Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: machine: x86_64 Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: clock source: unix Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: pcre jit disabled Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: detected number of CPU cores: 4 Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: current working directory: / Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: detected binary path: /usr/bin/uwsgi-core Jul 20 21:43:39.526082 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: your processes number limit is 47680 Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: your memory page size is 4096 bytes Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: detected max file descriptor number: 2048 Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: lock engine: pthread robust mutexes Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: thunder lock: enabled Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 21:43:39.526822 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 21:43:39.570722 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: Python main interpreter initialized at 0x556c4c8c89c0 Jul 20 21:43:39.570722 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: python threads support enabled Jul 20 21:43:39.570722 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: your server socket listen backlog is limited to 100 connections Jul 20 21:43:39.570722 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: your mercy for graceful operations on workers is 90 seconds Jul 20 21:43:39.571103 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 21:43:39.571186 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: *** Operational MODE: preforking *** Jul 20 21:43:39.571411 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: *** uWSGI is running in multiple interpreter mode *** Jul 20 21:43:39.571411 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: spawned uWSGI master process (pid: 109633) Jul 20 21:43:39.571589 dv-cinder-849690-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 21:43:39.574168 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: spawned uWSGI worker 1 (pid: 109634, cores: 1) Jul 20 21:43:39.574168 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: spawned uWSGI worker 2 (pid: 109635, cores: 1) Jul 20 21:43:39.574168 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 21:43:40.235852 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 21:43:40.237821 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 21:43:41.354698 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:43:41.354698 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: from cryptography.utils import int_from_bytes Jul 20 21:43:41.355295 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:43:41.355295 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: from cryptography.utils import int_from_bytes Jul 20 21:43:41.364589 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:43:41.364589 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: from cryptography.utils import int_from_bytes Jul 20 21:43:41.365115 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:43:41.365115 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: from cryptography.utils import int_from_bytes Jul 20 21:43:43.833489 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:43:43.834061 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:43:43.834252 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:43:43.834610 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:43:43.834870 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:43:43.835294 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.835621 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.835942 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.836136 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:43:43.836515 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.836609 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:43:43.836691 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.836872 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.836979 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:43:43.837188 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.837284 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:43:43.837504 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.837590 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:43:43.837829 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.837928 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838090 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838211 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838405 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838550 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838731 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-5-iscsi {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.838870 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839054 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839263 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839387 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839554 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839736 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839883 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.839993 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840205 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840298 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840538 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840639 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840810 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.840916 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.841134 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.841370 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.841494 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-5-iscsi {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.842684 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.842848 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.842925 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.842994 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843096 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843186 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843257 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843331 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843406 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843479 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843552 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843649 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843726 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843803 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.843927 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844123 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844237 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844448 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844546 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844750 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.844937 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-5-iscsi {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845065 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845249 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845407 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845546 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845733 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.845856 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846047 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846262 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846375 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846575 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846683 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.846894 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847005 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847222 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847315 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847544 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847724 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-5-iscsi {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.847884 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848051 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848157 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848447 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848592 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848804 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.848927 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.849165 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.849417 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.849505 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.849723 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.849811 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850029 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850130 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850343 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850438 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850645 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850738 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.850950 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851078 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851222 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851384 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851549 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851714 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.851850 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852041 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852297 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852401 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852561 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852651 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852790 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.852956 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853045 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853268 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853354 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853584 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853673 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853890 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.853977 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854196 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854282 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854454 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854542 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854771 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.854871 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855102 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855208 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855503 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855718 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855804 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.855992 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856088 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856250 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856338 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856574 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856662 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.856900 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857000 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857214 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857301 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857525 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857612 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857840 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.857935 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858150 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858236 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858456 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858542 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858766 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.858854 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859101 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859223 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859409 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859498 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859726 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.859815 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860045 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860138 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860348 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860434 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860651 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860739 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.860973 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861106 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861274 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861382 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861601 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861688 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.861903 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862027 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862152 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862250 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862452 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862540 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862756 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.862841 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863078 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863181 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863396 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863492 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863702 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.863790 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.864784 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.864997 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865092 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865329 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865416 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865661 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865762 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.865962 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866048 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866296 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866411 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866554 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866730 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866869 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.866957 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867212 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867310 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867519 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867631 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867807 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.867896 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868127 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868234 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868438 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868556 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868744 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.868862 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869061 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869162 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869370 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869466 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869682 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869779 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.869993 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870081 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870303 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870400 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870700 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.870922 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871009 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871248 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871350 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871552 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871640 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871868 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.871955 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872172 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872261 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872476 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872563 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872783 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.872868 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873081 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873178 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873381 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873479 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873696 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.873783 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874002 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874100 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874299 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874394 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874596 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874686 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874896 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.874992 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875218 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875309 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875526 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875824 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.875913 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876125 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876230 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876417 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876514 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876730 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.876818 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877039 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877126 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877339 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877433 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877644 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877742 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.877946 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878041 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878249 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878344 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878557 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878651 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.878865 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.878958 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.879198 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.879303 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.879506 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.880228 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.880415 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.880504 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.880721 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.880819 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.881045 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.881132 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.881356 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.881449 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.881667 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.881756 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.881977 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.882062 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.882285 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.882381 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.882595 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.882685 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:43:43.882905 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.882993 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883248 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883338 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883566 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883663 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883893 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.883981 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884211 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884319 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884521 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884614 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884837 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.884932 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885145 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885242 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885467 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885575 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885791 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.885881 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886104 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886202 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886410 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886506 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886729 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.886817 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887054 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887251 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887396 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887484 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887718 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.887806 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888036 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888200 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888344 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888431 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888654 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888743 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.888960 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889061 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889280 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889370 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889604 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889698 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.889916 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890011 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890228 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890314 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890540 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890649 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890849 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.890939 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891185 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891278 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891503 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891615 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891814 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.891912 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892151 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892239 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892465 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892553 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892779 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.892875 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893087 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893174 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893404 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893501 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893714 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.893810 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894024 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894112 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894330 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894426 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894631 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894719 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.894932 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895020 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895286 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895395 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895593 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895879 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.895992 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896235 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896331 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896556 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896646 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896858 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.896948 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897187 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897276 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897491 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897579 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897799 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.897887 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898106 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898203 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898411 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898500 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898713 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.898811 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899020 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899155 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899354 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899443 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899655 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899792 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.899976 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900073 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900283 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900379 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900581 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900669 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900901 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.900997 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901202 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901290 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901560 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901661 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901811 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.901900 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902120 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902220 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902426 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902527 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902737 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.902827 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903044 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903222 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903384 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903481 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903692 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.903779 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904004 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904102 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904320 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904408 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904634 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904723 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.904935 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905033 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905252 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905349 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905558 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905652 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905876 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.905961 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906175 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906271 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906482 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906570 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906783 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.906870 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907103 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907213 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907408 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907496 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907711 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.907805 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908014 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908110 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908316 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908404 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908618 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908754 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.908920 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909010 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909221 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909308 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909542 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909639 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909843 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.909939 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910143 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910231 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910446 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910534 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910746 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.910852 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.911129 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.911431 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.911522 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.911764 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.911875 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912086 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912175 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912400 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912487 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912711 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.912800 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913019 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913102 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913329 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913411 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913634 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913727 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.913944 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914033 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914255 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914354 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914562 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914650 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914874 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.914969 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915202 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915304 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915526 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915624 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.915924 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916153 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916249 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916459 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916546 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916778 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.916865 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917081 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917250 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917391 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917480 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917726 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.917815 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918054 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918150 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918364 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918458 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918679 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918766 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.918986 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919115 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919330 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919419 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919637 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919724 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.919947 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920036 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920254 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920343 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920563 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920658 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920877 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.920966 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921186 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921273 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921494 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921590 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921804 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.921927 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922126 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922227 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922429 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922516 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.922839 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923044 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923194 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923375 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923465 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923699 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.923788 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924015 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924102 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924318 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924413 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924625 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924712 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.924937 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925022 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925238 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925332 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925547 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925644 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925854 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.925943 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.926155 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.926253 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.926978 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.927142 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.927304 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.927383 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.927704 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.927801 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928017 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928116 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928338 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928432 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928666 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928753 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.928979 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929073 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929288 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929385 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929593 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929689 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929895 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.929994 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930207 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930306 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930526 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930623 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930828 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.930915 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931164 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931262 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931475 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931565 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931774 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.931875 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932079 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932192 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932394 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932490 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932701 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.932790 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933003 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933100 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933304 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933393 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933607 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.933913 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934009 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934229 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934352 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934527 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934628 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934841 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.934954 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935181 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935282 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935496 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935595 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935807 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.935926 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936126 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936233 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936421 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936519 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936735 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.936833 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937045 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937145 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937349 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937456 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937656 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.937754 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938042 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938156 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938268 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938374 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938575 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938673 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938892 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.938980 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939224 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939315 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939622 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939838 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.939934 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940139 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940282 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940446 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940535 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940757 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.940843 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941320 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941410 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941651 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941745 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.941965 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.942113 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.942877 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.943263 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.943449 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.943734 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.943822 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944063 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944164 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944389 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944483 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944707 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.944795 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945023 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945112 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945336 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945512 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945650 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.945739 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946003 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946115 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946267 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946527 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946615 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946871 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.946989 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947200 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947311 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947538 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947625 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947862 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.947967 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948169 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948259 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948472 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948566 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948777 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.948865 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949080 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949168 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949393 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949491 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949697 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.949792 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950008 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950109 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950314 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950401 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950636 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950727 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.950945 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951043 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951274 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951369 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951578 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951668 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951880 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.951970 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952188 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952274 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952498 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952597 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952825 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.952964 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953118 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953207 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953441 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953529 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953752 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.953841 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954053 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954140 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954367 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954462 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954667 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954755 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.954969 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955090 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955296 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955398 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955606 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955701 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955913 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.955999 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956211 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956306 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956520 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956608 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956827 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.956914 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957133 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957230 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957441 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957539 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957766 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.957858 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958169 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958257 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958497 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958592 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958806 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.958893 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959135 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959236 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959441 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959529 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959740 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.959827 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960048 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960138 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960371 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960475 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960652 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960741 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.960957 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961047 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961259 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961346 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961569 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961663 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961869 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.961956 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962168 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962260 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962470 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962573 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962777 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.962865 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963106 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963217 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963413 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963511 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963718 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.963812 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964031 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964118 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964331 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964434 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964633 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964729 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.964939 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965027 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965238 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965328 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965540 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965628 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965845 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.965921 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966152 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966242 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966460 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966561 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.966846 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967094 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967197 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967395 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967483 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967725 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.967841 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968008 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968096 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968313 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968406 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968611 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968707 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.968913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969001 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969218 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969304 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969527 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969628 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969842 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.969930 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970171 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970265 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970477 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970629 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970784 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.970873 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971106 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971209 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971410 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971576 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971720 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.971814 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972031 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972119 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972346 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972447 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972655 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972744 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.972964 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.973054 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.973770 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.973912 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974168 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974347 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974483 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974671 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974813 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.974987 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975151 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975324 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975466 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975643 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975777 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.975954 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976089 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976267 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976440 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976575 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976753 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.976879 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977117 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977204 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977436 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977537 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977759 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.977848 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978085 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978179 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978402 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978497 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978717 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.978804 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979019 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979135 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979363 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979465 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979670 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979764 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.979976 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980064 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980281 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980368 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980586 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980722 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980894 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.980981 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981202 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981304 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981512 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981600 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981822 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.981916 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982130 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982220 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982433 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982525 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982739 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.982826 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983046 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983179 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983374 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983461 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983697 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983793 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.983999 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984128 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984300 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984388 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984606 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984704 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.984907 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985002 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985213 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985309 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985515 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985831 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.985939 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986148 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986242 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986461 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986563 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986779 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.986866 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987237 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987445 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987556 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987769 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.987865 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988079 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988173 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988381 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988483 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988693 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.988785 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.989106 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.989229 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.989655 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.989965 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990058 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990359 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990507 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990672 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990813 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.990982 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991087 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991325 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991415 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991641 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991740 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.991946 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992033 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992252 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992346 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992555 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992645 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992863 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.992950 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993166 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993287 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993488 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993609 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993904 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.993992 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994213 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994301 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994522 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994829 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.994936 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995170 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995262 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995505 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995603 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995817 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.995904 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996128 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996270 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996442 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996542 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996767 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.996855 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997077 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997174 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997383 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997471 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997706 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.997821 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998028 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998126 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998340 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998430 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998653 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.998948 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999076 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999175 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999300 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999495 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999621 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999826 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:43.999935 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000155 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000243 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000486 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000653 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000798 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.000975 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001119 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001283 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001435 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001603 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001765 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.001925 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002095 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002227 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002416 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002528 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002736 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.002823 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003045 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003184 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003395 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003484 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003724 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.003811 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.004034 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.004137 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.004344 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.004432 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.005184 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.005346 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.005492 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.005719 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.005921 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.006244 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.006333 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.006593 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.006690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.006939 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007025 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007290 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007391 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007604 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007706 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.007925 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008013 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008243 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008332 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008546 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008646 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008866 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.008954 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009175 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009263 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009478 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009575 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009780 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.009880 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010081 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010169 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010395 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010484 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010705 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.010793 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011021 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011161 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011360 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011457 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011685 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011773 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.011993 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012081 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012320 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012415 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012640 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012727 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.012950 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013114 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013264 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013360 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013577 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013671 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013878 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.013979 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014180 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014276 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014490 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014594 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014788 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.014885 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015109 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015211 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015415 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015513 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015721 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.015820 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016023 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016113 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016323 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016459 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016626 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016719 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.016949 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017038 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017251 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017351 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017573 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017670 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017878 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.017967 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018181 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018270 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018484 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018574 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018786 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.018874 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019150 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019249 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019453 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019545 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019786 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.019893 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.020094 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.020227 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.020955 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.021085 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.021372 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.021461 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.021688 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.021996 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022094 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022316 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022411 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022631 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022719 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.022946 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023036 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023286 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023379 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023599 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023686 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.023911 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024002 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024221 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024309 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024527 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024622 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024840 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.024928 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025155 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025243 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025484 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025594 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025826 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.025996 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026162 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026329 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026480 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026640 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026810 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.026959 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.027161 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.027401 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.027506 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.027689 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.027800 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028004 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028093 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028314 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028413 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028622 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.028712 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029027 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029121 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029342 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029443 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029666 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029763 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.029988 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030077 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030310 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030410 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030652 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030841 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.030963 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031204 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031320 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031530 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031619 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031848 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.031944 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032168 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032273 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032490 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032586 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032810 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.032913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033127 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033233 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033440 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033533 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033752 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.033846 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034061 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034154 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034372 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034468 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034686 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.034782 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035001 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035117 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035339 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035440 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035653 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035760 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.035988 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.036195 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.036294 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.036633 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.036744 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.036944 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037034 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037261 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037357 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037576 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037666 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037891 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.037981 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.038207 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.038295 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.038569 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.038738 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.038898 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039041 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039248 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039396 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039570 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039721 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.039894 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040046 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040216 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040360 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040536 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040711 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.040856 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041001 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041197 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041329 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041502 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041593 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041834 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.041922 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042176 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042264 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042477 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042566 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042796 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.042894 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043130 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043222 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043438 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043530 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043754 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.043967 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.044063 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.044290 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.044575 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.044666 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.044924 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045036 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045236 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045334 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045561 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045651 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045885 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.045972 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046197 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046295 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046503 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046600 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046842 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.046948 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047142 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047246 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047448 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047538 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047761 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.047848 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048067 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048164 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048368 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048457 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048672 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048778 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.048976 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049075 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049280 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049371 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049583 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049816 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.049914 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050176 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050265 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050494 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050581 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050798 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.050899 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051122 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051227 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051474 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051570 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051807 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.051905 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052132 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052228 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052446 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052543 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052750 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.052839 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053054 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053142 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053365 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053462 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053669 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053768 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.053972 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054070 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054279 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054369 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054591 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054696 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.054947 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055047 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055217 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055321 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055527 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055623 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055859 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.055949 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056161 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056271 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056462 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056552 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056770 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.056854 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057076 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057173 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057394 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057482 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057703 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.057791 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058007 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058103 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058317 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058632 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058721 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.058943 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059188 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059522 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059664 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059841 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.059982 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060170 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060291 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060499 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060609 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060804 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.060971 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061109 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061301 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061411 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061732 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.061923 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062039 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062245 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062345 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062563 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062652 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062893 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.062983 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063238 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063340 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063550 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063647 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063863 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.063963 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.064168 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.064256 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.064475 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.064728 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.064820 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065106 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065211 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065373 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065461 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065680 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065771 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.065993 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066091 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066331 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066430 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066638 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066726 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.066947 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.067587 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.067832 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.067994 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068161 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068256 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068432 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068530 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068740 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.068850 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069044 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069139 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069350 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069439 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069664 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.069766 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070011 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070110 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070330 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070420 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070648 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070738 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.070968 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071078 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071311 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071400 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071629 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071764 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.071948 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072037 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072272 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072370 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072604 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.072923 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073012 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073234 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073405 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073552 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073642 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073860 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.073949 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074175 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074273 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074493 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074619 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074811 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.074929 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075149 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075289 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075452 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075567 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075755 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.075880 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076061 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076178 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076372 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076501 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076734 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076863 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.076988 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077100 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077312 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077439 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077598 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077745 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.077906 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078061 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078210 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078388 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078505 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078716 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.078834 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.079035 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.079180 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.079829 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.079929 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080024 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080108 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080108 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080245 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080324 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080564 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080653 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.080866 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081003 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081168 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081268 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081475 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081564 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081775 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.081904 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082078 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082168 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082379 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082471 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082729 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.082887 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.083030 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.083370 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.083702 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.083702 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.083950 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084067 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084238 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084357 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084563 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084688 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084878 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.084995 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085194 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085313 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085512 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085635 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085827 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.085960 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086138 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086254 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086442 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086557 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086750 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.086882 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087084 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087211 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087424 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087546 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087701 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.087837 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088010 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088128 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088319 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088413 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088628 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088726 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.088940 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089038 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089254 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089356 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089557 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089653 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089883 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.089986 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090196 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090294 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090514 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090605 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090826 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.090922 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091162 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091261 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091507 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091616 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091801 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.091931 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092111 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092214 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092417 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092514 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092727 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.092816 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093034 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093139 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093348 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093438 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093657 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093746 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.093969 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094078 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094282 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094370 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094591 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094678 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094904 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.094995 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095252 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095356 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095561 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095649 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095885 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.095975 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096207 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096297 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096540 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096637 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096853 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.096942 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097179 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097266 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097502 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097591 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097811 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.097900 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.098122 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.098211 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.098975 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.099308 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.099308 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:43:44.099452 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.099637 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.099963 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.100282 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.100606 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.100925 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.101250 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.101575 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.101898 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.102236 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.102571 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.102890 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.103246 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.103585 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.103939 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.104260 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.104612 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.104948 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.105269 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.105589 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.105901 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:43:44.106154 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:43:44.160717 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO dbcounter [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Registered counter for database nova_api Jul 20 21:43:44.169290 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO dbcounter [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Registered counter for database nova_api Jul 20 21:43:44.276683 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_db.sqlalchemy.engines [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.280210 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_db.sqlalchemy.engines [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.283258 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writer thread running {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.287208 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writer thread running {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.339476 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.context [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb646c5e-8d70-4d2e-9cfe-402204556fef(cell1) {{(pid=109634) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 21:43:44.342939 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.context [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb646c5e-8d70-4d2e-9cfe-402204556fef(cell1) {{(pid=109635) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 21:43:44.343341 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_concurrency.lockutils [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:43:44.344963 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_concurrency.lockutils [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:43:44.345762 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_concurrency.lockutils [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:43:44.346869 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:43:44.348050 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_concurrency.lockutils [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:43:44.349084 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:43:44.349888 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:43:44.350856 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO dbcounter [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Registered counter for database nova_cell0 Jul 20 21:43:44.352075 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:43:44.354069 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO dbcounter [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Registered counter for database nova_cell0 Jul 20 21:43:44.354861 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO dbcounter [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Registered counter for database nova_cell1 Jul 20 21:43:44.357962 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO dbcounter [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Registered counter for database nova_cell1 Jul 20 21:43:44.362877 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_db.sqlalchemy.engines [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.365103 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_db.sqlalchemy.engines [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.367711 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_db.sqlalchemy.engines [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.370300 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writer thread running {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.370934 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_db.sqlalchemy.engines [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.372233 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writer thread running {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.374252 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writer thread running {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.515852 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writer thread running {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.523274 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO dbcounter [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Registered counter for database nova_cell0 Jul 20 21:43:44.526059 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO dbcounter [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Registered counter for database nova_cell0 Jul 20 21:43:44.532317 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG oslo_db.sqlalchemy.engines [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.533811 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_db.sqlalchemy.engines [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:43:44.537050 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writer thread running {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.538553 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writer thread running {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:43:44.880940 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: WARNING keystonemiddleware.auth_token [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:43:44.886087 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: WARNING keystonemiddleware.auth_token [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:43:44.888300 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: WARNING keystonemiddleware.auth_token [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:43:44.893331 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: WARNING keystonemiddleware.auth_token [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:43:45.233338 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: WARNING keystonemiddleware.auth_token [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:43:45.239684 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: WARNING keystonemiddleware.auth_token [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:43:45.243355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: WARNING keystonemiddleware.auth_token [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:43:45.244989 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c4c8c89c0 pid: 109635 (default app) Jul 20 21:43:45.247047 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:43:45.248251 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] 10.222.0.86 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jul 20 21:43:45.248659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 788 bytes} [Wed Jul 20 21:43:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:43:45.249256 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: WARNING keystonemiddleware.auth_token [None req-d36af8ae-edf5-4527-abf4-90e979c6ac7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:43:45.254449 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c4c8c89c0 pid: 109634 (default app) Jul 20 21:45:01.295980 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:01.296984 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 20 21:45:01.297402 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 2/2] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:01.310234 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_api:SELECT=3 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:01.311170 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_cell0:SELECT=3 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:01.312192 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_cell1:SELECT=3 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:01.312950 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:02.186172 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-2a0579a0-5430-4e53-b6b4-e52ec32d4940 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:02.218656 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-2a0579a0-5430-4e53-b6b4-e52ec32d4940 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913429 Jul 20 21:45:02.220214 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1291 bytes} [Wed Jul 20 21:45:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:04.468598 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:04.469672 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-53352c2d-0b6c-468f-af38-b51b5461e2ca None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 20 21:45:04.470247 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 3/4] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:45:04.960012 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-b5029963-86bd-4fa6-acd3-4bb3c083ea3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "vcpus": 1, "name": "cirros256", "disk": 1}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:04.978206 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:45:04.978206 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: warnings.warn(msg) Jul 20 21:45:05.005698 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-b5029963-86bd-4fa6-acd3-4bb3c083ea3c admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528797 Jul 20 21:45:05.006446 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 2/5] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 21:45:05.020446 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_api:SELECT=3 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:05.021422 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_cell0:SELECT=3 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:05.022203 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_cell1:SELECT=3 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:05.023450 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:05.235665 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-e2342f9b-e275-4f4d-abbd-6d761748e96b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:05.238661 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:45:05.238661 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:45:05.303927 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-e2342f9b-e275-4f4d-abbd-6d761748e96b admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289218 Jul 20 21:45:05.311863 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 4/6] 10.222.0.86 () {64 vars in 1335 bytes} [Wed Jul 20 21:45:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:45:07.623256 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-b5029963-86bd-4fa6-acd3-4bb3c083ea3c admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:07.624281 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-b5029963-86bd-4fa6-acd3-4bb3c083ea3c admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 20 21:45:07.624724 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 3/7] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:08.401503 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-a4d75ea3-3cf4-4aec-a6ae-61b0c87517b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:08.421128 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:45:08.421128 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:45:08.445038 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-a4d75ea3-3cf4-4aec-a6ae-61b0c87517b8 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.811435 Jul 20 21:45:08.446498 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 5/8] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:08.461052 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-9a40e573-f06f-4577-b64d-19f051678715 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:08.462999 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:45:08.462999 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: warnings.warn(msg) Jul 20 21:45:08.507423 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-9a40e573-f06f-4577-b64d-19f051678715 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051803 Jul 20 21:45:08.508206 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 4/9] 10.222.0.86 () {64 vars in 1335 bytes} [Wed Jul 20 21:45:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:10.892982 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-a4d75ea3-3cf4-4aec-a6ae-61b0c87517b8 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:10.894147 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-a4d75ea3-3cf4-4aec-a6ae-61b0c87517b8 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jul 20 21:45:10.895158 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 6/10] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:45:11.350111 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-c0a7254f-7644-4595-a8da-673096cfc6fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "vcpus": 1, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:11.367667 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-c0a7254f-7644-4595-a8da-673096cfc6fc admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466040 Jul 20 21:45:11.368215 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 5/11] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:11.380470 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-72955907-10c3-4d1d-95da-737dba9ab568 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:11.403214 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-72955907-10c3-4d1d-95da-737dba9ab568 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026714 Jul 20 21:45:11.403781 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 7/12] 10.222.0.86 () {64 vars in 1335 bytes} [Wed Jul 20 21:45:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:45:13.668272 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-c0a7254f-7644-4595-a8da-673096cfc6fc admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:13.669340 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-c0a7254f-7644-4595-a8da-673096cfc6fc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 20 21:45:13.669812 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 6/13] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:14.132584 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-c0c0445d-17d0-4540-91c6-a52032d1ecfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:14.160716 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-c0c0445d-17d0-4540-91c6-a52032d1ecfc admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485147 Jul 20 21:45:14.161881 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 8/14] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:14.174789 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-d4060f27-080e-4981-81e7-3547e75f6038 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:14.198643 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-d4060f27-080e-4981-81e7-3547e75f6038 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028620 Jul 20 21:45:14.207654 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 7/15] 10.222.0.86 () {64 vars in 1335 bytes} [Wed Jul 20 21:45:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:16.445127 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-c0c0445d-17d0-4540-91c6-a52032d1ecfc admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:16.446150 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-c0c0445d-17d0-4540-91c6-a52032d1ecfc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 20 21:45:16.446558 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 9/16] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:16.885119 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:16.904267 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450887 Jul 20 21:45:16.911569 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 8/17] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:16.917566 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-d61c9041-518d-4057-9848-bcf2d3e1f41f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:16.946813 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-d61c9041-518d-4057-9848-bcf2d3e1f41f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032559 Jul 20 21:45:16.948150 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 10/18] 10.222.0.86 () {64 vars in 1335 bytes} [Wed Jul 20 21:45:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:19.209670 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:19.210892 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Jul 20 21:45:19.211359 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 9/19] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:19.655095 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-49bb01ee-570a-401c-8f42-69c61a3da451 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:19.679440 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-49bb01ee-570a-401c-8f42-69c61a3da451 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461810 Jul 20 21:45:19.679987 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1291 bytes} [Wed Jul 20 21:45:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:21.995926 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:21.996946 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-5aecae48-d838-4d2e-aeee-1eddb49a3c86 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 20 21:45:21.997359 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 10/21] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:22.467738 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-cbba4f14-2f83-4cd6-8eed-884ecbb77984 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "ram": 512}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:22.485421 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-cbba4f14-2f83-4cd6-8eed-884ecbb77984 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482147 Jul 20 21:45:22.486476 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 12/22] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:22.498570 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-74d2218f-7320-45fd-8dbc-5dd14d8bf11e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:22.523435 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-74d2218f-7320-45fd-8dbc-5dd14d8bf11e admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028418 Jul 20 21:45:22.523996 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 11/23] 10.222.0.86 () {64 vars in 1332 bytes} [Wed Jul 20 21:45:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:45:24.872383 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-cbba4f14-2f83-4cd6-8eed-884ecbb77984 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:24.873397 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-cbba4f14-2f83-4cd6-8eed-884ecbb77984 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 20 21:45:24.873798 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:25.273634 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-c9ffe960-47c7-4f75-b634-63cd4ea4680a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:25.291621 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-c9ffe960-47c7-4f75-b634-63cd4ea4680a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411519 Jul 20 21:45:25.292203 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 12/25] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:25.304959 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-6ad66869-fc60-4c1b-acfb-f53197e23f30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:25.326659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-6ad66869-fc60-4c1b-acfb-f53197e23f30 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025300 Jul 20 21:45:25.327365 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 14/26] 10.222.0.86 () {64 vars in 1332 bytes} [Wed Jul 20 21:45:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:28.084365 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-c9ffe960-47c7-4f75-b634-63cd4ea4680a admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:28.085543 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-c9ffe960-47c7-4f75-b634-63cd4ea4680a admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 20 21:45:28.086036 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:28.517026 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-587591c0-db12-4f54-ac4a-1c0a72ff6e36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:28.536497 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-587591c0-db12-4f54-ac4a-1c0a72ff6e36 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.444153 Jul 20 21:45:28.537930 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 15/28] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:28.553567 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-dbb08876-8d14-4a44-a86a-6f10b5f5e63e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:28.586305 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-dbb08876-8d14-4a44-a86a-6f10b5f5e63e admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040201 Jul 20 21:45:28.587203 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 14/29] 10.222.0.86 () {64 vars in 1332 bytes} [Wed Jul 20 21:45:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:30.981230 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-587591c0-db12-4f54-ac4a-1c0a72ff6e36 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:30.982249 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-587591c0-db12-4f54-ac4a-1c0a72ff6e36 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 20 21:45:30.982656 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 16/30] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:31.450458 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-d3855a98-541a-4d15-b4d1-2eb11cf8a319 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:31.457263 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:31.476039 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-d3855a98-541a-4d15-b4d1-2eb11cf8a319 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.486420 Jul 20 21:45:31.477406 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 15/31] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:31.490178 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-3aa95480-d490-4ac3-84d8-90c3836aad35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:31.515220 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-3aa95480-d490-4ac3-84d8-90c3836aad35 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029892 Jul 20 21:45:31.516370 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 17/32] 10.222.0.86 () {64 vars in 1332 bytes} [Wed Jul 20 21:45:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:45:33.955324 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-d3855a98-541a-4d15-b4d1-2eb11cf8a319 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:33.957082 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-d3855a98-541a-4d15-b4d1-2eb11cf8a319 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003080 Jul 20 21:45:33.958059 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 16/33] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:34.471920 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:34.494415 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.529995 Jul 20 21:45:34.495841 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 18/34] 10.222.0.86 () {64 vars in 1282 bytes} [Wed Jul 20 21:45:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:45:34.508027 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-aefaae30-6825-4fa4-88d6-d0e59d97f776 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:45:34.538648 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-aefaae30-6825-4fa4-88d6-d0e59d97f776 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034447 Jul 20 21:45:34.543248 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 17/35] 10.222.0.86 () {64 vars in 1332 bytes} [Wed Jul 20 21:45:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:45:54.459625 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:54.460647 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 20 21:45:54.461044 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 19/36] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:54.471744 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:54.862339 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-f0d7aa2d-190a-43b0-a3f4-a5ff66cc350a admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:54.879931 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-f0d7aa2d-190a-43b0-a3f4-a5ff66cc350a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413135 Jul 20 21:45:54.880471 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 18/37] 10.222.0.86 () {60 vars in 1291 bytes} [Wed Jul 20 21:45:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:55.970357 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:55.971410 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-de306ffd-8142-472a-a2d9-467fffe58c8c admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002478 Jul 20 21:45:55.971846 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 20/38] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:56.504314 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-a7a55001-29fd-45a8-b331-b00b652e6542 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:56.509886 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.wsgi [None req-a7a55001-29fd-45a8-b331-b00b652e6542 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-a7a55001-29fd-45a8-b331-b00b652e6542 admin admin] Request method failure captured: Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept: application/json Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept-Encoding: gzip, deflate Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Connection: keep-alive Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Content-Length: 0 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Host: 10.222.0.86 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-System-Scope: None Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: User-Agent: python-novaclient Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Auth-Token: gAAAAABi2HeTH6YfsV6w0g9KiisXn3dkWEKUHy_ifC7GiH8PWIkIH2_24RvuWt5o9GtEn74ZN7cW90oQjx_wOOtGRrfcMXshO5G-nl9raQlfGsPgR2WpoeMYE7GnUecamx3UsQvNWi_DHV8TuXeIJD16N3X9mYaqWXbd34JTmYqniSGehDZInH0 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Id: None Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Name: None Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Identity-Status: Confirmed Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Is-Admin-Project: True Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Id: default Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Name: Default Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Name: admin Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Role: admin,reader,member Jul 20 21:45:56.513183 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Roles: admin,reader,member Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant: admin Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Name: admin Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User: admin Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Id: default Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Name: Default Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Name: admin Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: method: > Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: exception: Flavor 42 could not be found. Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: action_args: {'id': '42'} Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:56.514690 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:56.516231 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.517760 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-a7a55001-29fd-45a8-b331-b00b652e6542 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:56.519229 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-a7a55001-29fd-45a8-b331-b00b652e6542 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400670 Jul 20 21:45:56.519229 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 19/39] 10.222.0.86 () {60 vars in 1190 bytes} [Wed Jul 20 21:45:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:45:56.524898 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-1cb71687-10ae-41ef-b92b-634c18941acb admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:56.527932 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:45:56.548231 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-1cb71687-10ae-41ef-b92b-634c18941acb admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026838 Jul 20 21:45:56.548794 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 21/40] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:56.558599 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-e2d420dc-d46c-44bd-8a04-3d8e845ecb40 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:56.580142 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-e2d420dc-d46c-44bd-8a04-3d8e845ecb40 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025064 Jul 20 21:45:56.580702 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 20/41] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:56.590725 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-2648396b-6192-4051-b7a5-dc07862e240e admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:56.598007 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.wsgi [None req-2648396b-6192-4051-b7a5-dc07862e240e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-2648396b-6192-4051-b7a5-dc07862e240e admin admin] Request method failure captured: Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept: application/json Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept-Encoding: gzip, deflate Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Connection: keep-alive Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Content-Length: 0 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Host: 10.222.0.86 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-System-Scope: None Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: User-Agent: python-novaclient Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Auth-Token: gAAAAABi2HeTH6YfsV6w0g9KiisXn3dkWEKUHy_ifC7GiH8PWIkIH2_24RvuWt5o9GtEn74ZN7cW90oQjx_wOOtGRrfcMXshO5G-nl9raQlfGsPgR2WpoeMYE7GnUecamx3UsQvNWi_DHV8TuXeIJD16N3X9mYaqWXbd34JTmYqniSGehDZInH0 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Id: None Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Name: None Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Identity-Status: Confirmed Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Is-Admin-Project: True Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Id: default Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Name: Default Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Name: admin Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Role: admin,reader,member Jul 20 21:45:56.601352 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Roles: admin,reader,member Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant: admin Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Name: admin Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User: admin Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Id: default Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Name: Default Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Name: admin Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: method: > Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: exception: Flavor 42 could not be found. Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: action_args: {'id': '42'} Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:56.602897 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:56.604083 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:56.605403 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-2648396b-6192-4051-b7a5-dc07862e240e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:56.606397 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-2648396b-6192-4051-b7a5-dc07862e240e admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016208 Jul 20 21:45:56.606397 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 22/42] 10.222.0.86 () {60 vars in 1190 bytes} [Wed Jul 20 21:45:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:45:57.587769 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-e2d420dc-d46c-44bd-8a04-3d8e845ecb40 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:57.588936 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-e2d420dc-d46c-44bd-8a04-3d8e845ecb40 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jul 20 21:45:57.589376 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:58.167763 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-b806806e-a10e-4d2a-94cf-59ec40f843be admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:58.173583 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.wsgi [None req-b806806e-a10e-4d2a-94cf-59ec40f843be admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-b806806e-a10e-4d2a-94cf-59ec40f843be admin admin] Request method failure captured: Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept: application/json Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept-Encoding: gzip, deflate Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Connection: keep-alive Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Content-Length: 0 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Host: 10.222.0.86 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-System-Scope: None Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: User-Agent: python-novaclient Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Auth-Token: gAAAAABi2HeVSQiRKV6L_mVTSncAtPl_ryyL4Ojo6CLAj5RNjgi_lr-6lYXrJt4rt4NVAGQsE-XvekIrs1l4yDo_JWDWnJdjl3NudS9fppgAQDcyUf4ZOyb2S2g4S-_bPSmw7P_HczrzqI6aYFK096W-Exp8HUwJCKasezfMX8WIIY1_I72_rR0 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Id: None Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Name: None Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Identity-Status: Confirmed Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Is-Admin-Project: True Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Id: default Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Name: Default Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Name: admin Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Role: admin,reader,member Jul 20 21:45:58.175122 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Roles: admin,reader,member Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant: admin Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Name: admin Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User: admin Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Id: default Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Name: Default Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Name: admin Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: method: > Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: exception: Flavor 84 could not be found. Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: action_args: {'id': '84'} Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:58.176713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:58.177780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.179305 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-b806806e-a10e-4d2a-94cf-59ec40f843be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:58.180713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-b806806e-a10e-4d2a-94cf-59ec40f843be admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.431239 Jul 20 21:45:58.180713 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 23/44] 10.222.0.86 () {60 vars in 1190 bytes} [Wed Jul 20 21:45:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:45:58.186236 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-804bc7b3-01c8-4afa-a1ed-c3f3ddf3f079 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:58.200869 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-804bc7b3-01c8-4afa-a1ed-c3f3ddf3f079 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018117 Jul 20 21:45:58.201449 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 22/45] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:58.211780 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-e7e14c89-418b-4060-830c-1ca85e0c7c20 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:58.225949 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-e7e14c89-418b-4060-830c-1ca85e0c7c20 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017833 Jul 20 21:45:58.226524 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 24/46] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:58.236679 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-863fe779-b779-4105-a611-dc54038a1471 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:58.242491 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.wsgi [None req-863fe779-b779-4105-a611-dc54038a1471 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-863fe779-b779-4105-a611-dc54038a1471 admin admin] Request method failure captured: Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept: application/json Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept-Encoding: gzip, deflate Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Connection: keep-alive Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Content-Length: 0 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Host: 10.222.0.86 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-System-Scope: None Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: User-Agent: python-novaclient Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Auth-Token: gAAAAABi2HeVSQiRKV6L_mVTSncAtPl_ryyL4Ojo6CLAj5RNjgi_lr-6lYXrJt4rt4NVAGQsE-XvekIrs1l4yDo_JWDWnJdjl3NudS9fppgAQDcyUf4ZOyb2S2g4S-_bPSmw7P_HczrzqI6aYFK096W-Exp8HUwJCKasezfMX8WIIY1_I72_rR0 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Id: None Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Name: None Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Identity-Status: Confirmed Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Is-Admin-Project: True Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Id: default Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Name: Default Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Name: admin Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Role: admin,reader,member Jul 20 21:45:58.244040 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Roles: admin,reader,member Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant: admin Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Name: admin Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User: admin Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Id: default Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Name: Default Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Name: admin Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: method: > Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: exception: Flavor 84 could not be found. Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: action_args: {'id': '84'} Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:58.245588 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:58.246532 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:58.247743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-863fe779-b779-4105-a611-dc54038a1471 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:58.248737 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-863fe779-b779-4105-a611-dc54038a1471 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013168 Jul 20 21:45:58.248737 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 23/47] 10.222.0.86 () {60 vars in 1190 bytes} [Wed Jul 20 21:45:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:45:59.263132 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-e7e14c89-418b-4060-830c-1ca85e0c7c20 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:59.264149 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-e7e14c89-418b-4060-830c-1ca85e0c7c20 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 20 21:45:59.264549 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 25/48] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:45:59.821524 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-0e5b9e7b-c402-4595-9c0c-db8a5d77983d admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:59.827308 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.wsgi [None req-0e5b9e7b-c402-4595-9c0c-db8a5d77983d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-0e5b9e7b-c402-4595-9c0c-db8a5d77983d admin admin] Request method failure captured: Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept: application/json Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Accept-Encoding: gzip, deflate Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Connection: keep-alive Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Content-Length: 0 Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Host: 10.222.0.86 Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Openstack-System-Scope: None Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: User-Agent: python-novaclient Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Auth-Token: gAAAAABi2HeXjx_nIAFUPf1OzEzgGk4GZJPGPlBaFTNbsNZsZbMu_awMmMgfpMoFFgATz6jdX2MVoTWjuwChv27K_oKdk-OKNU7PdZGR_u1uuz_JV7p11MYjtlFtL7zTk6Yj4IleJf3y9BpEgCakOtjHvLgG9-F6c-kqVxZePRILbIZnVZNyPJs Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Id: None Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Domain-Name: None Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Identity-Status: Confirmed Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Is-Admin-Project: True Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Id: default Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Domain-Name: Default Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Project-Name: admin Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Role: admin,reader,member Jul 20 21:45:59.828833 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Roles: admin,reader,member Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant: admin Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-Tenant-Name: admin Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User: admin Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Id: default Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Domain-Name: Default Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: X-User-Name: admin Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: method: > Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: exception: Flavor 451 could not be found. Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: action_args: {'id': '451'} Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:59.830355 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:59.831414 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.832913 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-0e5b9e7b-c402-4595-9c0c-db8a5d77983d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:59.834508 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-0e5b9e7b-c402-4595-9c0c-db8a5d77983d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.427022 Jul 20 21:45:59.834508 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 24/49] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:45:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:45:59.840136 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-91c1507b-3d3c-43f3-9135-706751caee58 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:59.854571 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-91c1507b-3d3c-43f3-9135-706751caee58 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017843 Jul 20 21:45:59.855223 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 26/50] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:45:59.866224 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:59.881165 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018746 Jul 20 21:45:59.881717 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 25/51] 10.222.0.86 () {60 vars in 1210 bytes} [Wed Jul 20 21:45:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:45:59.891515 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-f0465c65-24b9-481a-b53b-a2b54243e15d admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:45:59.897061 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.wsgi [None req-f0465c65-24b9-481a-b53b-a2b54243e15d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-f0465c65-24b9-481a-b53b-a2b54243e15d admin admin] Request method failure captured: Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept: application/json Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Accept-Encoding: gzip, deflate Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Connection: keep-alive Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Content-Length: 0 Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Host: 10.222.0.86 Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-Api-Version: compute 2.90 Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Openstack-System-Scope: None Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: User-Agent: python-novaclient Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Auth-Token: gAAAAABi2HeXjx_nIAFUPf1OzEzgGk4GZJPGPlBaFTNbsNZsZbMu_awMmMgfpMoFFgATz6jdX2MVoTWjuwChv27K_oKdk-OKNU7PdZGR_u1uuz_JV7p11MYjtlFtL7zTk6Yj4IleJf3y9BpEgCakOtjHvLgG9-F6c-kqVxZePRILbIZnVZNyPJs Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Id: None Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Domain-Name: None Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Identity-Status: Confirmed Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Is-Admin-Project: True Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Id: default Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Domain-Name: Default Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Project-Name: admin Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Role: admin,reader,member Jul 20 21:45:59.898692 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Roles: admin,reader,member Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_feb77f81bd3a4077b594b0faf70919df", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/feb77f81bd3a4077b594b0faf70919df"}]}] Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant: admin Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Id: feb77f81bd3a4077b594b0faf70919df Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-Tenant-Name: admin Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User: admin Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Id: default Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Domain-Name: Default Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Id: ec67f4a1435249d49af5a7f7df4f7a39 Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: X-User-Name: admin Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: method: > Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: exception: Flavor 451 could not be found. Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: action_args: {'id': '451'} Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:45:59.900414 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:59.901478 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: ERROR nova.api.openstack.wsgi Jul 20 21:45:59.902659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-f0465c65-24b9-481a-b53b-a2b54243e15d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:45:59.903745 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-f0465c65-24b9-481a-b53b-a2b54243e15d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012531 Jul 20 21:45:59.903745 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 27/52] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:45:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 21:46:00.940574 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:00.941604 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 20 21:46:00.942009 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 26/53] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:46:01.474154 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-5fcec1ab-24ac-4058-b7f5-efd60ff05976 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:46:01.493887 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-5fcec1ab-24ac-4058-b7f5-efd60ff05976 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.413489 Jul 20 21:46:01.494449 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 28/54] 10.222.0.86 () {64 vars in 1235 bytes} [Wed Jul 20 21:46:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:46:02.509295 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:02.510323 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 20 21:46:02.510724 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 27/55] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:46:03.057680 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-3fb280d4-37ef-4745-ae9b-05db62fed79c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:46:03.076389 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-3fb280d4-37ef-4745-ae9b-05db62fed79c admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.424908 Jul 20 21:46:03.076951 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 29/56] 10.222.0.86 () {64 vars in 1235 bytes} [Wed Jul 20 21:46:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:46:04.073070 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:04.074084 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 20 21:46:04.074489 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 28/57] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:46:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:46:04.622548 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-1e5fe7f6-f9d2-4edb-8368-0ebad2fe9191 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:46:04.640912 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-1e5fe7f6-f9d2-4edb-8368-0ebad2fe9191 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.419583 Jul 20 21:46:04.641699 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 30/58] 10.222.0.86 () {64 vars in 1235 bytes} [Wed Jul 20 21:46:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:46:05.631774 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:05.632779 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 20 21:46:05.633185 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 29/59] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:46:06.211272 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-ebed6a74-2de9-4457-8b59-bb826d7c088a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:46:06.229082 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-ebed6a74-2de9-4457-8b59-bb826d7c088a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450104 Jul 20 21:46:06.229628 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 31/60] 10.222.0.86 () {64 vars in 1235 bytes} [Wed Jul 20 21:46:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:46:07.229745 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:07.230800 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 20 21:46:07.231236 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 30/61] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:46:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:46:07.771599 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-7935ca93-2208-4d3c-ae88-04459b9461b1 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:46:07.790659 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-7935ca93-2208-4d3c-ae88-04459b9461b1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.417975 Jul 20 21:46:07.791235 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 32/62] 10.222.0.86 () {60 vars in 1202 bytes} [Wed Jul 20 21:46:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:47:02.416701 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.417753 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-58b11a8a-8035-4e0c-a6d7-339dab64a45e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 20 21:47:02.418159 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 31/63] 10.222.0.86 () {54 vars in 930 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:47:02.429700 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:47:02.846610 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-2a732d9d-0325-473d-984f-cab2b03d990b admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.867308 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-2a732d9d-0325-473d-984f-cab2b03d990b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.442114 Jul 20 21:47:02.867884 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 33/64] 10.222.0.86 () {60 vars in 1291 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:47:02.890826 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG dbcounter [-] [109634] Writing DB stats nova_api:SELECT=14 {{(pid=109634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:47:02.894567 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-40a22610-8873-4493-8039-4f11fd11fd44 admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.902604 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-40a22610-8873-4493-8039-4f11fd11fd44 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014358 Jul 20 21:47:02.903203 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 32/65] 10.222.0.86 () {60 vars in 1282 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:47:02.915811 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-bb47c9e3-747f-47ef-a76f-7292b071e8d0 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.923767 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-bb47c9e3-747f-47ef-a76f-7292b071e8d0 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011557 Jul 20 21:47:02.924314 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 34/66] 10.222.0.86 () {60 vars in 1285 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:47:02.937104 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.945059 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012406 Jul 20 21:47:02.945617 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1285 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:47:02.958371 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-94f0a1b9-35d0-48a9-83db-9fc9c647bc82 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:47:02.966239 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-94f0a1b9-35d0-48a9-83db-9fc9c647bc82 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011455 Jul 20 21:47:02.966787 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 35/68] 10.222.0.86 () {60 vars in 1282 bytes} [Wed Jul 20 21:47:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:33.706290 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:33.707335 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 21:50:33.707743 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 34/69] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:50:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:50:33.854224 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_api:SELECT=6 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.036092 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:34.037287 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:50:34.037287 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:50:34.038497 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:34.039466 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:34.040242 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:34.040665 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:34.076062 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-45b7b86d-42c3-4452-a9c7-680805125b68 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.223216 Jul 20 21:50:34.076553 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 36/70] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:50:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:34.944121 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:34.945178 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 20 21:50:34.945587 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 35/71] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:50:35.148444 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:35.149657 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:50:35.149657 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:50:35.150882 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:35.151357 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:35.152170 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:35.152604 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:35.172464 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-c472221a-b1d6-4d0b-bc4e-41618403a2af admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083482 Jul 20 21:50:35.173053 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 37/72] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:50:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:46.454795 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:46.455859 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 20 21:50:46.456271 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 36/73] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:50:46.609976 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_cell0:SELECT=4 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.610729 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_cell1:SELECT=4 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.611515 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG dbcounter [-] [109635] Writing DB stats nova_api:SELECT=8 {{(pid=109635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.665856 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:46.666969 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:50:46.666969 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:50:46.668261 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:46.668707 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:46.669510 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:46.669947 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:46.696482 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-d4f73276-11f5-4d19-a1bf-1c6e88810861 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091230 Jul 20 21:50:46.697059 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 38/74] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:50:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:50:47.576009 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: DEBUG nova.api.openstack.wsgi [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] Calling method '>' {{(pid=109634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:47.577483 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: INFO nova.api.openstack.requestlog [None req-3985e37a-43a4-4538-8f1a-bc2fe4615dfb admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jul 20 21:50:47.578364 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: [pid: 109634|app: 0|req: 37/75] 10.222.0.86 () {56 vars in 1074 bytes} [Wed Jul 20 21:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:50:47.781507 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG nova.api.openstack.wsgi [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] Calling method '>' {{(pid=109635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:50:47.783442 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 21:50:47.783442 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: warnings.warn(msg) Jul 20 21:50:47.785374 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:47.786108 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:47.787401 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:50:47.788113 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: DEBUG oslo_concurrency.lockutils [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:50:47.822442 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: INFO nova.api.openstack.requestlog [None req-018eb317-fc34-4e6f-a1f7-850f98da7ba7 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.101008 Jul 20 21:50:47.823018 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: [pid: 109635|app: 0|req: 39/76] 10.222.0.86 () {60 vars in 1193 bytes} [Wed Jul 20 21:50:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:51:46.402630 dv-cinder-849690-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 21:51:46.403501 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: Wed Jul 20 21:51:46 2022 - graceful shutdown triggered... Jul 20 21:51:46.403955 dv-cinder-849690-5-iscsi devstack@n-api.service[109634]: Gracefully killing worker 1 (pid: 109634)... Jul 20 21:51:46.404467 dv-cinder-849690-5-iscsi devstack@n-api.service[109635]: Gracefully killing worker 2 (pid: 109635)... Jul 20 21:51:47.404103 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: worker 1 buried after 1 seconds Jul 20 21:51:47.404103 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: worker 2 buried after 1 seconds Jul 20 21:51:47.404103 dv-cinder-849690-5-iscsi devstack@n-api.service[109633]: goodbye to uWSGI. Jul 20 21:51:47.405782 dv-cinder-849690-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 21:51:47.406366 dv-cinder-849690-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 21:51:47.409283 dv-cinder-849690-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 21:51:47.421340 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 21:51:47 2022] *** Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: nodename: dv-cinder-849690-5-iscsi Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: machine: x86_64 Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: clock source: unix Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: pcre jit disabled Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: detected number of CPU cores: 4 Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: current working directory: / Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: detected binary path: /usr/bin/uwsgi-core Jul 20 21:51:47.423551 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: your processes number limit is 47680 Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: your memory page size is 4096 bytes Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: detected max file descriptor number: 2048 Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: lock engine: pthread robust mutexes Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: thunder lock: enabled Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 21:51:47.424418 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 21:51:47.469980 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: Python main interpreter initialized at 0x5566fc0fc9c0 Jul 20 21:51:47.469980 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: python threads support enabled Jul 20 21:51:47.469980 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: your server socket listen backlog is limited to 100 connections Jul 20 21:51:47.469980 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: your mercy for graceful operations on workers is 90 seconds Jul 20 21:51:47.470742 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 21:51:47.470742 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: *** Operational MODE: preforking *** Jul 20 21:51:47.470742 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: *** uWSGI is running in multiple interpreter mode *** Jul 20 21:51:47.470742 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: spawned uWSGI master process (pid: 124136) Jul 20 21:51:47.470905 dv-cinder-849690-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 21:51:47.472381 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: spawned uWSGI worker 1 (pid: 124150, cores: 1) Jul 20 21:51:47.472381 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: spawned uWSGI worker 2 (pid: 124151, cores: 1) Jul 20 21:51:47.472381 dv-cinder-849690-5-iscsi devstack@n-api.service[124136]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 21:51:48.157468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 21:51:48.175665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 21:51:49.366412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:51:49.366412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: from cryptography.utils import int_from_bytes Jul 20 21:51:49.367468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:51:49.367468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: from cryptography.utils import int_from_bytes Jul 20 21:51:49.384549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:51:49.384549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: from cryptography.utils import int_from_bytes Jul 20 21:51:49.385068 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:51:49.385068 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: from cryptography.utils import int_from_bytes Jul 20 21:51:51.779115 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:51:51.779929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:51:51.779929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:51:51.780354 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:51:51.780561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:51:51.780982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.781298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.781630 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.781961 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.782303 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.782624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.782954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.783315 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.783655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.783926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.784251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.784589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-5-iscsi {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.784926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.785243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.785568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.785898 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.786211 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.786543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.786859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.787399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.787852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.788169 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.788527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.788906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.789232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.789551 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.789886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.790201 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.790534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.790857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.791303 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-5-iscsi {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.791634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.791958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.792278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.792710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.793026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.793346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.793721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.794031 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.794347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.794683 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.795013 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.795369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.795697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.796011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.796328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.796647 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.796977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.797297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.797611 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.797866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.798183 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.798510 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.798837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.799194 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.799456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.799718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.800046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.800372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.800690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.801007 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.801318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.801632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.801951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.802344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.802699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.803018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.803395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.803722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.804663 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.805075 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.805256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.805667 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.805926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.806247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.806600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.806930 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.807278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.807610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.807946 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.808263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.808590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.808924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.809428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.809945 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.810273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.810550 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.811092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.811467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.811775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.812096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.812421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.812742 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.813058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.813381 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.813696 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.814014 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.814366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.814682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.815002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.815350 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.815668 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.815988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.816319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.816651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.816968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.817288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.817610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.817923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.818256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.818569 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.818884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.819251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.819566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.820446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.820914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.821236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.821600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.821874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.822189 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.822509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.822837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.823179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.823503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.823817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.824132 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.824449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.824765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.825078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.825394 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.825704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.826034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.826363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.826684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.827001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.827351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.827675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.828025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.828368 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.828722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.829076 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.829390 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.829730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.830058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.830378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.830764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.831237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.831399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.831875 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.832238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.835102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.836827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.836827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.836827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.836827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.837404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.837548 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.839982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.840307 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.840717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.841047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.841385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.841712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.842035 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.842360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.842689 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.843015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.843396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.843726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.844055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.844378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.844705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.845029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.845701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.845701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.845964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.846276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.846590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.846908 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.847265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.847604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.847932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.848606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.848790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.849214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.849616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.850133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.850420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.850778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.854646 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.855283 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.855644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.856061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.856466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.856874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.858365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.858743 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.859171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.859486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.859947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.860311 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.861414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.861780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.862140 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.862483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.862822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.863210 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.863568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.863896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.864241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.864587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.864922 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.865273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.865603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.865924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.866248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.867148 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.867462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.867920 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.868144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.868424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.868745 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.869066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.869404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.869729 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.870047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.870365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.870681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.871040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.871382 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.871740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.872092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.872424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.872760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.873200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.873418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.873745 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.874067 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.874392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.874715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.875049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.875403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.875730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.876056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.876392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.876716 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.877050 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.877374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.877704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.878059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.878404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.878734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.879086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.879420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.879748 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.880072 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.880396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.880719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.881043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.881372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.881695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.882034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.883236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.883672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.883979 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.884315 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.884631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.884957 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.885301 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.885649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.885974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.886299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.886634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.886956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.887309 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.887636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.887959 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.888278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.888602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.888931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.889251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.889574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.889890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.890215 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.890537 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.890852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.891194 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.891518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.891867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.892177 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.892506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.892839 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.893155 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.893469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.893803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.894122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.894440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.894755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.895135 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.895448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.895770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.896084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.896412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.896742 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.897063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.897392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.897726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.898080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.898412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.898736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.899235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.899486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.899923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.900288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.900674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.901024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.901384 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.901837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.902058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.902329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.902653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.903037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.903894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.904445 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.904783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.905129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.905451 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.905897 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.906226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.906793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.907282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.907735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.908163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.908711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.909157 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.909711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.910053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.910387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.910982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.911242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.911547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.911834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.912150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.912470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.912805 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.913124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.913782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.914451 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.914667 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.914827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.915194 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.916040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.916040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.916387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.916565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.916792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.917265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.917470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.917776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.918148 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.918397 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.918721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.919034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.919379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.919706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.920031 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.920347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.920671 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.920998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.921319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.921771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.921970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.922257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.922571 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.923015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.923271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.923522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.923893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.924370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.924574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.924799 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.925228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.925419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.925827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.926020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.926300 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.926617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.926941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.927403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.927591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.927954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.928244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.928563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.928879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.929820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.930153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.930470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.930793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.931152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.931484 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.931803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.932126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.932444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.932763 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.933086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.933404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.933722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.934043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.934356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.934670 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.934984 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.935385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.935784 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.936143 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.936305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.936572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.936933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.937252 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.937679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.937924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.938258 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.938589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.938913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.939261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.939587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.939903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.940233 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.940556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.940882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.941200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.941516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.941852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.942217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.942492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.942828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.943840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.943840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.943840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.944463 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.944463 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.945329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.945682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.945966 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.946390 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.946559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.946767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:51:51.947378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.947566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:51:51.947955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.947955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.948266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:51:51.948588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.948740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:51:51.948885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.949036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:51:51.949180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.949421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.949570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.949732 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.949732 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.950063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.950208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.950494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.950494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.950772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.950772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.951041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.951041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.951398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.951586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.951742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.951929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.952077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.952077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.952514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.952673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.952817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.952959 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-5-iscsi {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.953121 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.953283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.953436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.953595 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.953748 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.953905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.954047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.954203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.954462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.954633 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.955934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.956207 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.956593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.956756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.956925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.957150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.957417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.957581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.957741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.958121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.958311 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.958530 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.958750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.959213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.959512 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.959789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.960062 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.960296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.960571 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.960843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.961079 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.961324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.961554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.961777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.961990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.962237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.962456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.962754 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-5-iscsi {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.962921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.963102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.963515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.963670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.963670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.963964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.963964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.964247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.964401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.964667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.964667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.965061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.965215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.965578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.965770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.966205 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.966496 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.966847 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.966997 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.967185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.967349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.967531 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.967680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.967899 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.968257 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.968418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.968563 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.968714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.968859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.969016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.969308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.969409 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.969582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.969687 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.969781 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.969874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.970037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.970182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.970332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.970477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.970628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.970628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.970925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.970925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.971235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.971382 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.971526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.971690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.971843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.971988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.972139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.972295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.972446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.972618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.972770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.972770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.973232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.973381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.973532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.973687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.973830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.974567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.974847 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.975008 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.975207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.975207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.975493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.975493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.975493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.975493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.975493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.977188 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.977342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.977486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.977629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.977773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.977930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.978082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.978629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.978796 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.978940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.979110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.979274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.979559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.979719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.979873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.980025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.980186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.980331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.980549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.980707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.980851 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.980851 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.981146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.981297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.981449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.981600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.981600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.981877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.982036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.982221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.982395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.982674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.982823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.982979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.983158 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.983448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.983631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.983779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.983931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.984217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.984414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.984564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.984718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.984718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.985120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.985284 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.985284 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.985583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.985734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.985885 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.986028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.986028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.986390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.986533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.986533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.987323 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.987475 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.987475 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.987768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.987927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.987927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.988232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.988506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.988738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.988894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.988894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.989174 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.989326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.989326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.989738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.989888 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.989888 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.990186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.990339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.990493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.991251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.991251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.991541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.992328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.992328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.992795 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.992949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.992949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.993222 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.993391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.993391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.993823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.993966 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.993966 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.994262 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.994544 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.994711 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.994855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.994855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.995358 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.995513 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.995513 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.995816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.995968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.996112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.996265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.996265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.996555 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.996700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.996700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.997146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.997512 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.997512 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.997795 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.997947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.998104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.998304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.998474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.998737 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.998994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.999167 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.999167 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.999459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:51.999605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:51.999927 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.000080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.000080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.000396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.000566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.000566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.000865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.001017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.001017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.001299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.001460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.001611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.001815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.001815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.002115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.002115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.002434 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.002586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.002736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.002889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.003039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.003264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.003420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.003578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.003887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.004316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.004316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.004735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.004908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.005060 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.005332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.005488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.005662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.005821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.005972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.006122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.006279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.006279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.006574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.006574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.006882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:51:52.007045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.007045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.007761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.007934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.008095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.008248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.008440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.008594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.008594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009616 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.009964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.010244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.010244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.010604 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.010757 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.010757 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.011909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012371 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.012966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013290 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013754 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.013924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.014399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.014564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.014564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.015022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.015227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.015227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.015646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.015842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016006 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016157 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016320 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016812 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.016973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.017257 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.017518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.017518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.018651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.019790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.020823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.021887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.022912 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023444 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023595 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023595 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.023988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.025294 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.025294 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.025760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.025970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.025970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.026326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.026511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.026683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.026846 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027467 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.027752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028920 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.028920 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.029375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.029654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.029819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.029977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.029977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.030279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.030580 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.030739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.030898 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.030898 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.031874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.032249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.032403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.032637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.032792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.032792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.033777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034229 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.034857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.035251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.035251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.035699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.035955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.035955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.036515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.036682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.036682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.036969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.037119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.037268 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.037410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.037410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.038006 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039031 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039211 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039524 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039847 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.039847 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.040982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041635 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.041999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.042281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.042496 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.042652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.042919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.043112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.043268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.043605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.043758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.043955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.044260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.044360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.044612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.044859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.044964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.045235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.045552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.045874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.045985 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.046203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.046492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.046594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.046899 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.047081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.047198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.047473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.047689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.047791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.048092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.048256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.048477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.048721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.048816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.049039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.049359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.049450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.049672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.049985 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.050090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.050294 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.050542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.050644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.051054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052745 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052745 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.052887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.053074 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.053410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.053503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.053734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057587 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.057988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058481 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.058942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.059016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.059286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.059465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.059694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.059905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.060059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.060334 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.060468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.060663 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061595 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.061977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.062143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.062299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.062622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.062776 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.062940 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.063279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.063413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.063603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.063931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.064055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.064253 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.064566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.064722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.064893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.065171 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.065289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.065543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.065794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.065912 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.066183 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.066393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.066522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.066841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.066982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.067313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.067541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.067667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.067898 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.068119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.068245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.068550 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.068686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.069001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.069187 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.069404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.069540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:51:52.069908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.070737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.071387 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.071603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.071956 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.072289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.072635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.072940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.073272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.073626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.073975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.074300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.074636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.074957 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.075325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.075646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.075968 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.076287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.076606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.076933 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.077433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.077638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.077880 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.078210 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.078525 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.079201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.079201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.079542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.079818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.080158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.080487 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.080780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.081107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.081422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.081746 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.082039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.082347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.082657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.082971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.083319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.083634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.083947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.084255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.084571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.084882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.085189 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.085614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.086102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.086558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.086882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.087251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.087658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.087888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.088198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.088526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.088849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.089159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.089449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.089786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.090107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.090643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.090861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.091212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.091538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.091921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.092172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.092485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.092797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.093127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.093448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.093756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.094069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.094379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.094689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.095000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.095352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.095662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.095997 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.096284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.096586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.096895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.097214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.097861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.098195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.098510 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.098838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.099197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.099516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.099850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.100176 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.100520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.100831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.101926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.102100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.102325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.102708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.103015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.103342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.103650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.104192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.104427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.104667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.105984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.105984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.105984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.107002 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.107318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.107646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.108029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.108319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.108636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.108953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.109275 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.109669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.109944 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.110292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.110627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.111185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.111456 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.111770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.112102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.112413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.112722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.113033 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.113350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.113661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.113969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.114285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.114597 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.114910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.115374 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.115682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.115995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.116352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.117376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.117874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.118191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.118498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.118818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.119156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.119474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.119787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.120095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.120413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.120718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.121195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.121403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.121722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.122036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.122341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.122673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.122984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.123317 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.123624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.123936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.124240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.124544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.124851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.125176 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.125495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.125801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.126114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.126421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.126729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.127038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.127370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.127680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.127996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.128280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.128592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.128896 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.129224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.129539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.129841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.130147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.130450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.130799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.131122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.131486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.131791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.132104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.132508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.132845 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.133132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.133447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.133875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.134065 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.134379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.134692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.135000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.135332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.135658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.135969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.136347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.136675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.137000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.137425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.137734 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.138047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.138360 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.138673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.138989 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.139331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.139646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.139958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.140269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.140583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.140892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.141201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.141513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.141822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.142128 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.142458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.142768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.143104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.143411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.143718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.144029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.144336 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.144779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.145090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.145400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.145705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.146016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.146326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.146640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.146967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.147301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.147732 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.148638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.148638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.148898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.149854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.150167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.150484 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.150817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.151577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.151577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.152012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.152243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.152459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.152681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.153277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.153496 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.153808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.154222 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.154534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.154847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.155213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.155540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.155961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.156272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.156591 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.156903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.157230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.157552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.157867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.158179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.158486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.158809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.159162 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.159535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.159794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.160224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.160547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.160857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.161181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.161509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.161820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.162118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.162431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.162737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.163044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.163390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.164238 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.164551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.164862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.165173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.165480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.165783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.166105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.166411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.166736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.167052 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.167393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.167714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.168019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.168341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.168653 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.168954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.169260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.169701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.169912 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.170202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.170523 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.170851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.171205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.171515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.171849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.172174 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.172488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.172807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.173130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.173433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.173736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.174205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.174349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.174643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.174949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.175280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.175585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.175887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.176189 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.176507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.176809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.177129 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.177436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.177739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.178045 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.178349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.178689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.178992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.180069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.180392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.180720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.181051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.181361 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.181685 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.182006 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.182322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.182637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.182949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.183286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.183601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.183915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.184223 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.184537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.184848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.185165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.185729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.186056 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.186373 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.186687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.186999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.187337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.187649 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.187959 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.188269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.188579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.188888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.189217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.189536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.189859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.190193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.190508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.190825 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.191159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.191476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.191829 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.192193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.192443 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.193582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.193913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.194236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.195156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.195156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.195396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.195536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.195840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.196153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.196498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.196782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.197109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.197442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.197765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.198080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.198395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.198714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.200594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.200818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.201173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.201514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.201852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.202182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.202513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.202849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.203191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.203507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.203822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.204136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.204448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.204772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.205088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.205399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.205720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.206038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.206589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.206943 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.207289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.207617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.207945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.208265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.208573 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.208902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.209208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.209515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.209830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.210141 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.210552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.210782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.211111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.211521 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.211833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.212147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.212457 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.212786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.213092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.213395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.213702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.214013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.214318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.214621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.214929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.215285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.215598 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.215903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.216212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.216516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.216827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.217134 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.217440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.217789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.218156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.218464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.218774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.219114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.219428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.219752 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.220065 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.220378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.220729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.221046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.221605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.221939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.222258 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.222596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.222923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.223254 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.223562 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.223867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.224191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.224522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.224801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.225113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.225431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.225739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.226671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.227361 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.227512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.227760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.228853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.228853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.228853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.229201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.229332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.229616 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.229934 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.230253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.230634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.230960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.235706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO dbcounter [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Registered counter for database nova_api Jul 20 21:51:52.236121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.236940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.237278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.237610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.237936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.238245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.238553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.238860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.239197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.239522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.239835 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.240142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.240449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.240782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.241062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.241368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.242340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.242766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.243164 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.243403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.243711 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.244020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.244327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.244632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.244937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.245397 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.245549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.245847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.246151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.246459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.246780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.247127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.247465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.247786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.248113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.248425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.248746 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.249061 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.249382 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.249708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.250031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.250347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.250680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.251919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.251919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.251919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.252558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.252558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.252879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.253099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.253267 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.253546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.253883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.254198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.254529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.254850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.255200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.255538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.255837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.255837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.256682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.256868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.257310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_db.sqlalchemy.engines [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.257621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.257621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.258479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.258479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.258479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.259142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.259142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.259427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.259773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.260089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.260322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.260676 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.261008 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.261324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.261647 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.261967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.262281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.262589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:51:52.262835 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:51:52.264180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writer thread running {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.327360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.context [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb646c5e-8d70-4d2e-9cfe-402204556fef(cell1) {{(pid=124150) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 21:51:52.332046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:51:52.334228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:51:52.335165 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:51:52.338444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:51:52.340976 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO dbcounter [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Registered counter for database nova_cell0 Jul 20 21:51:52.346057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO dbcounter [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Registered counter for database nova_cell1 Jul 20 21:51:52.355366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_db.sqlalchemy.engines [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.358339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_db.sqlalchemy.engines [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.367103 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writer thread running {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.367688 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writer thread running {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.419353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO dbcounter [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Registered counter for database nova_api Jul 20 21:51:52.439340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_db.sqlalchemy.engines [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.446553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writer thread running {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.503538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.context [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb646c5e-8d70-4d2e-9cfe-402204556fef(cell1) {{(pid=124151) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 21:51:52.507640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:51:52.509198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:51:52.509991 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:51:52.512004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:51:52.514097 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO dbcounter [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Registered counter for database nova_cell0 Jul 20 21:51:52.518218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO dbcounter [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Registered counter for database nova_cell0 Jul 20 21:51:52.518430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO dbcounter [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Registered counter for database nova_cell1 Jul 20 21:51:52.525635 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_db.sqlalchemy.engines [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.527338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_db.sqlalchemy.engines [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.528724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_db.sqlalchemy.engines [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.530567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writer thread running {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.535628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writer thread running {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.537246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writer thread running {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.684885 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO dbcounter [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Registered counter for database nova_cell0 Jul 20 21:51:52.691822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_db.sqlalchemy.engines [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:51:52.696366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writer thread running {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:51:52.856566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: WARNING keystonemiddleware.auth_token [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:51:52.863937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: WARNING keystonemiddleware.auth_token [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:51:53.019464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: WARNING keystonemiddleware.auth_token [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:51:53.027655 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: WARNING keystonemiddleware.auth_token [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:51:53.211758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: WARNING keystonemiddleware.auth_token [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:51:53.218463 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: WARNING keystonemiddleware.auth_token [None req-ae417fcf-10d8-491b-96af-2d081a660770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:51:53.225325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566fc0fc9c0 pid: 124150 (default app) Jul 20 21:51:53.385938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: WARNING keystonemiddleware.auth_token [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 21:51:53.392701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: WARNING keystonemiddleware.auth_token [None req-805cffad-791d-4834-8e8f-9eedde384255 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 21:51:53.399533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566fc0fc9c0 pid: 124151 (default app) Jul 20 21:52:36.107219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:36.108067 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:36.109485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:36.110924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:38.107553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-64b6d068-55c4-4e0f-87c8-ffd50fc41a05 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Action: 'create', calling method: .version_select at 0x7f6abc64aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-669623706"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:39.734743 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-64b6d068-55c4-4e0f-87c8-ffd50fc41a05 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.643632 Jul 20 21:52:39.736815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 1/1] 10.222.0.86 () {60 vars in 1154 bytes} [Wed Jul 20 21:52:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3648 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 21:52:40.355233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-dd6080bb-f721-4165-95ae-043613b01060 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc704820>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:40.449442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:40.450661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:40.451779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:40.452850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:40.877833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-dd6080bb-f721-4165-95ae-043613b01060 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 200 len: 345 microversion: 2.1 time: 1.130120 Jul 20 21:52:40.879315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 1/2] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:39 2022] GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 345 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:40.893337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1df627b0-5683-447b-afc3-a73115e14cef tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Action: 'create', calling method: .version_select at 0x7f6abc516a60>, body: {"snapshot": {"volume_id": "60926a7c-4732-4928-991f-d9855076f298", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-369873321"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:41.258121 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1df627b0-5683-447b-afc3-a73115e14cef tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.369488 Jul 20 21:52:41.259097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 2/3] 10.222.0.86 () {60 vars in 1161 bytes} [Wed Jul 20 21:52:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:41.273046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e9b7c35e-50a5-412d-aee7-12fd38b26f46 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc553af0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:41.369298 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e9b7c35e-50a5-412d-aee7-12fd38b26f46 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 286 microversion: 2.1 time: 0.102423 Jul 20 21:52:41.370931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:41 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:41.383030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4e72796c-b7ef-45c1-9707-6f4b0c53be7f tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc516e50>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:41.543106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4e72796c-b7ef-45c1-9707-6f4b0c53be7f tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.165611 Jul 20 21:52:41.544589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 3/5] 10.222.0.86 () {58 vars in 1139 bytes} [Wed Jul 20 21:52:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:41.556007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4c680995-29cb-47a8-b2f6-2fc4410a7b9d tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc553a60>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:41.746083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4c680995-29cb-47a8-b2f6-2fc4410a7b9d tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 286 microversion: 2.1 time: 0.194927 Jul 20 21:52:41.747483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 3/6] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:41 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:52:42.758085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c10145d5-18ed-4718-8dd2-aed6790147e5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc52a8b0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:42.802385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c10145d5-18ed-4718-8dd2-aed6790147e5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 286 microversion: 2.1 time: 0.048306 Jul 20 21:52:42.804234 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:42 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:43.815618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9b6c3e76-6aaa-42e8-8876-f8a3c0c42ea3 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc51b3a0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:43.870964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9b6c3e76-6aaa-42e8-8876-f8a3c0c42ea3 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 286 microversion: 2.1 time: 0.059484 Jul 20 21:52:43.872212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:43 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:44.887031 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f7a13b35-7818-4a38-8a93-3168ff3dc54c tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc535040>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:45.062894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f7a13b35-7818-4a38-8a93-3168ff3dc54c tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 287 microversion: 2.1 time: 0.181617 Jul 20 21:52:45.070443 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 5/9] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:44 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:45.077966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a6470b44-3ded-4914-a7e5-f4d158d6dbf9 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc51ba60>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:45.295905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a6470b44-3ded-4914-a7e5-f4d158d6dbf9 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "DELETE /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 202 len: 0 microversion: 2.1 time: 0.223375 Jul 20 21:52:45.298090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 5/10] 10.222.0.86 () {58 vars in 1253 bytes} [Wed Jul 20 21:52:45 2022] DELETE /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:52:45.311950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29537c35-4084-4c84-913a-0df45076cffd tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc52ac10>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:45.463038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-29537c35-4084-4c84-913a-0df45076cffd tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 200 len: 286 microversion: 2.1 time: 0.160424 Jul 20 21:52:45.468754 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 6/11] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:45 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:46.478667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c880c6ba-0c6d-42c1-8fa7-54e2f138876b tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc553a60>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:46.595754 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-c880c6ba-0c6d-42c1-8fa7-54e2f138876b tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] HTTP exception thrown: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c880c6ba-0c6d-42c1-8fa7-54e2f138876b tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Request method failure captured: Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 HTTP/1.1 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hkj0zzJmyEEvemmC1VPZ8phtqd2WEP7jjzM5NtEZ08Gw9BQebkdEw22vjja5jHp1QuRoh8verMnReD-T2a1IvLIbZBP4OfgMiAWqAetFrAD2VetTMRpNAijKGpts_kNzYe_B7Z6Er6v1TjJvRmF_dDqZ7dWJNFHNPblYjZ_A-owf74 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:52:46.603607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8a1f1bb699504cb38e176e5dabf3040e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}] Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 69a5796d5cbf4c6a9a8de1c9aa9c6ccf Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '92a12f45-cc67-46d8-94b9-094a01056001'} Jul 20 21:52:46.604907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. (HTTP 404) (Request-ID: req-b3654093-5e00-48ce-b608-2cf1272c4ca3) Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.605750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:46.606606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 21:52:46.607504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. Jul 20 21:52:46.608404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:46.610011 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c880c6ba-0c6d-42c1-8fa7-54e2f138876b tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Returning 404 to user: Snapshot 92a12f45-cc67-46d8-94b9-094a01056001 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:52:46.611265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c880c6ba-0c6d-42c1-8fa7-54e2f138876b tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001" status: 404 len: 111 microversion: 2.1 time: 0.139310 Jul 20 21:52:46.619444 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 21:52:46 2022] GET /compute/v2.1/os-snapshots/92a12f45-cc67-46d8-94b9-094a01056001 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:52:46.624027 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8eaec08f-5918-40ba-b39b-8855635633d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc52a4c0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:46.824619 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8eaec08f-5918-40ba-b39b-8855635633d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 202 len: 0 microversion: 2.1 time: 0.204916 Jul 20 21:52:46.829033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:52:46 2022] DELETE /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:52:46.836379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8eddb70e-1b9a-4224-9d84-6e89a53e7ec9 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abceab1f0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:47.078941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8eddb70e-1b9a-4224-9d84-6e89a53e7ec9 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 200 len: 344 microversion: 2.1 time: 0.247813 Jul 20 21:52:47.079840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 7/14] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:46 2022] GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:47.370064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f2b61688-69d3-4e3c-9fe3-71ad37428c98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: .version_select at 0x7f6abc66c8b0>, body: {"keypair": {"name": "tempest-keypair-1029290524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/m7B3MgyBDU7aDxw4TGUN1jJ0vt9ZqkO42j6Qgv+gjeBXv4TQbzS8VAgCnamYlpdWXeaur+uHFCZUe1Vg3JQSb4HIXYdpWSJJ0K4TmP3SQmW+deKGuLN1fCOGPRLZ/KQ=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:47.453064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-f2b61688-69d3-4e3c-9fe3-71ad37428c98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:52:47.466169 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-f2b61688-69d3-4e3c-9fe3-71ad37428c98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:52:47.554104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f2b61688-69d3-4e3c-9fe3-71ad37428c98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.589569 Jul 20 21:52:47.558073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 8/15] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:52:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:52:48.098418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cfa2aad3-0cc8-4a91-941d-8fe78bddf229 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc4ea5e0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:48.166122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-cfa2aad3-0cc8-4a91-941d-8fe78bddf229 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] HTTP exception thrown: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cfa2aad3-0cc8-4a91-941d-8fe78bddf229 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Request method failure captured: Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 HTTP/1.1 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hkj0zzJmyEEvemmC1VPZ8phtqd2WEP7jjzM5NtEZ08Gw9BQebkdEw22vjja5jHp1QuRoh8verMnReD-T2a1IvLIbZBP4OfgMiAWqAetFrAD2VetTMRpNAijKGpts_kNzYe_B7Z6Er6v1TjJvRmF_dDqZ7dWJNFHNPblYjZ_A-owf74 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:52:48.168996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8a1f1bb699504cb38e176e5dabf3040e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}] Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 69a5796d5cbf4c6a9a8de1c9aa9c6ccf Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '60926a7c-4732-4928-991f-d9855076f298'} Jul 20 21:52:48.170040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. (HTTP 404) (Request-ID: req-28839906-5d68-405c-9c63-84809a9d01c2) Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.170670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:48.171675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 21:52:48.173178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cfa2aad3-0cc8-4a91-941d-8fe78bddf229 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Returning 404 to user: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:52:48.175161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cfa2aad3-0cc8-4a91-941d-8fe78bddf229 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 404 len: 109 microversion: 2.1 time: 0.081643 Jul 20 21:52:48.179053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:48 2022] GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:52:48.183604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c20b2ab8-fd67-489b-9bc3-bc6dbddb5181 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc487f70>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:48.277373 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-c20b2ab8-fd67-489b-9bc3-bc6dbddb5181 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] HTTP exception thrown: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c20b2ab8-fd67-489b-9bc3-bc6dbddb5181 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Request method failure captured: Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 HTTP/1.1 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hkj0zzJmyEEvemmC1VPZ8phtqd2WEP7jjzM5NtEZ08Gw9BQebkdEw22vjja5jHp1QuRoh8verMnReD-T2a1IvLIbZBP4OfgMiAWqAetFrAD2VetTMRpNAijKGpts_kNzYe_B7Z6Er6v1TjJvRmF_dDqZ7dWJNFHNPblYjZ_A-owf74 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:52:48.286834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8a1f1bb699504cb38e176e5dabf3040e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}] Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 69a5796d5cbf4c6a9a8de1c9aa9c6ccf Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '60926a7c-4732-4928-991f-d9855076f298'} Jul 20 21:52:48.288542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. (HTTP 404) (Request-ID: req-0059a5a8-ce4d-4b4f-a748-835930f29251) Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.289174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 21:52:48.290089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 21:52:48.290964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.291877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.296356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c20b2ab8-fd67-489b-9bc3-bc6dbddb5181 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Returning 404 to user: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:52:48.297919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c20b2ab8-fd67-489b-9bc3-bc6dbddb5181 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 404 len: 109 microversion: 2.1 time: 0.118517 Jul 20 21:52:48.302889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 9/17] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:52:48 2022] DELETE /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 21:52:48.312687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef20762d-c15d-41b2-96ae-235082ad49d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Calling method '.version_select at 0x7f6abc4923a0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:48.391128 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-ef20762d-c15d-41b2-96ae-235082ad49d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] HTTP exception thrown: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef20762d-c15d-41b2-96ae-235082ad49d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Request method failure captured: Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 HTTP/1.1 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hkj0zzJmyEEvemmC1VPZ8phtqd2WEP7jjzM5NtEZ08Gw9BQebkdEw22vjja5jHp1QuRoh8verMnReD-T2a1IvLIbZBP4OfgMiAWqAetFrAD2VetTMRpNAijKGpts_kNzYe_B7Z6Er6v1TjJvRmF_dDqZ7dWJNFHNPblYjZ_A-owf74 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:52:48.396759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8a1f1bb699504cb38e176e5dabf3040e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8a1f1bb699504cb38e176e5dabf3040e"}]}] Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 8a1f1bb699504cb38e176e5dabf3040e Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1669284858 Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 69a5796d5cbf4c6a9a8de1c9aa9c6ccf Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1669284858-project Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '60926a7c-4732-4928-991f-d9855076f298'} Jul 20 21:52:48.398400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. (HTTP 404) (Request-ID: req-4832fb7c-10fd-4770-a8cb-cdf77fcd13bb) Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.399016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:52:48.400347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 21:52:48.401420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef20762d-c15d-41b2-96ae-235082ad49d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] Returning 404 to user: Volume 60926a7c-4732-4928-991f-d9855076f298 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:52:48.402299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ef20762d-c15d-41b2-96ae-235082ad49d5 tempest-VolumesSnapshotsTestJSON-1669284858 tempest-VolumesSnapshotsTestJSON-1669284858-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298" status: 404 len: 109 microversion: 2.1 time: 0.094952 Jul 20 21:52:48.405225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 9/18] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:48 2022] GET /compute/v2.1/os-volumes/60926a7c-4732-4928-991f-d9855076f298 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:52:55.855351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2117376449", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "networks": [{"uuid": "0cef960b-272b-43e0-a6e8-b28c88aa2d54"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:55.900415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-148c3e51-1210-46e6-9679-29c4f9422157 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Action: 'create', calling method: .version_select at 0x7f6abc553c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1174413806", "metadata": {"Type": "work"}}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:56.111287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] validate_networks() for [('0cef960b-272b-43e0-a6e8-b28c88aa2d54', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:52:56.801040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-148c3e51-1210-46e6-9679-29c4f9422157 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.163356 Jul 20 21:52:56.801969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 10/19] 10.222.0.86 () {60 vars in 1155 bytes} [Wed Jul 20 21:52:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1165 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 21:52:56.814345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9ee74dde-80ec-44e3-aec8-890029d69854 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abc553dc0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:52:56.922296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9ee74dde-80ec-44e3-aec8-890029d69854 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 200 len: 353 microversion: 2.1 time: 0.112620 Jul 20 21:52:56.922910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 11/20] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:56 2022] GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:52:57.490279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=4 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:57.680642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2020617119", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e24c0e-fc60-4c54-b80d-8c328d2228f9"}], "security_groups": [{"name": "tempest-securitygroup--204227654"}], "key_name": "tempest-keypair-1029290524", "user_data": "}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:52:58.430990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] validate_networks() for [('54e24c0e-fc60-4c54-b80d-8c328d2228f9', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:52:59.707644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:52:59.708141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:52:59.709580 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:52:59.709761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:52:59.710197 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:52:59.748211 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:52:59.749977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:52:59.752590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:52:59.755243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:52:59.815857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Getting quotas for project 932a50a36025440583c478450e42f9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:52:59.828388 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Getting quotas for user 74e755a5fe9f4c5c95376beae691381f and project 932a50a36025440583c478450e42f9e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:52:59.848998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:52:59.853210 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:52:59.959408 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-29fd3565-666f-42ef-a3a3-677777d5cdb8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.350935 Jul 20 21:52:59.960196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 10/21] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:52:59.973333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c732b7b3-7c89-4bc2-b4fb-41bae595985e tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abbbb2dc0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:00.037198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c732b7b3-7c89-4bc2-b4fb-41bae595985e tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 200 len: 354 microversion: 2.1 time: 0.069635 Jul 20 21:53:00.038199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 11/22] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:52:59 2022] GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:00.735594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-484759680", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:00.849080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] validate_networks() for [('3eef71be-0bf3-4fa0-b902-6d7954148e3f', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:53:01.009411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:01.010567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:01.011253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:01.011850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:01.012428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:01.034405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:01.035335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:01.037667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:01.038768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:01.125493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:01.144839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:01.173270 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:01.176449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:01.326786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-543a4cfe-78c2-4e3e-9801-7ce689356a9a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.660710 Jul 20 21:53:01.327823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 12/23] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:52:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:53:01.817217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:01.818314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:01.819153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:01.819724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:01.820288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:01.865578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:01.866460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:01.870637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:01.871362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:01.985312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:02.001513 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for user 1a0d4ce0ac4d47c8a184ea0291461379 and project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:02.067881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:02.074103 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:02.095722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9ead6779-421f-4d5f-b799-beee522970f7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: .version_select at 0x7f6abbba01f0>, body: {"keypair": {"name": "tempest-keypair-1779103835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/L8T4vN5C0hFVUDkIM77RLWjFrBw3Pvy5Pbg7G0pR9XcI4bsiA95ogKRF2t+HQIv/bI+AUNjtwoeU2wI86QRvwclW8SQNdOBlg+ytECtIgGK+gGqPp2yrkkcIhA60NsQ=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:02.168401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-9ead6779-421f-4d5f-b799-beee522970f7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:02.184963 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-9ead6779-421f-4d5f-b799-beee522970f7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for user fb27ee14314f42cc87e8e6bac2031c70 and project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:02.268536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9ead6779-421f-4d5f-b799-beee522970f7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.938035 Jul 20 21:53:02.277265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 13/24] 10.222.0.86 () {62 vars in 1199 bytes} [Wed Jul 20 21:53:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 948 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:02.290691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1814c69b-b58d-45c5-a727-cabe499f5fea tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:02.291584 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1814c69b-b58d-45c5-a727-cabe499f5fea tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:02.305342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c8c8cbea-b9f5-4cef-aa7d-f768ba849069 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.265899 Jul 20 21:53:02.310333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 12/25] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:53:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:53:02.326838 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-091c04ac-1e6d-4641-9f74-a83d6e951163 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abcef3af0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:02.517498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-091c04ac-1e6d-4641-9f74-a83d6e951163 tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 200 len: 354 microversion: 2.1 time: 0.205930 Jul 20 21:53:02.518331 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 13/26] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:53:02 2022] GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:02.557160 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1814c69b-b58d-45c5-a727-cabe499f5fea tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:02.602012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1814c69b-b58d-45c5-a727-cabe499f5fea tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1215 microversion: 2.1 time: 0.322804 Jul 20 21:53:02.603486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 14/27] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:02 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:02.610115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-245863bb-e2e0-4eaf-af6b-6de58d30fc4a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:02.611440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-245863bb-e2e0-4eaf-af6b-6de58d30fc4a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:02.817477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-245863bb-e2e0-4eaf-af6b-6de58d30fc4a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:02.838118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-245863bb-e2e0-4eaf-af6b-6de58d30fc4a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1242 microversion: 2.1 time: 0.230090 Jul 20 21:53:02.841421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 15/28] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:02 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:02.887215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2f2e1de1-840f-4080-9fe8-1b6902e7961c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:02.898706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2f2e1de1-840f-4080-9fe8-1b6902e7961c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:03.179765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2f2e1de1-840f-4080-9fe8-1b6902e7961c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:03.182621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ee65b577-5f8f-48ca-aa29-96170e234d4e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: .version_select at 0x7f6abbb55940>, body: {"keypair": {"name": "tempest-keypair-2104392816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYnyL7bADqvFdY5M8XCfZSBieRFYXc+SQbcVLHCoQ2oEMhUVFwSKLS/u9hZx3HgKRxZ2QyXgzwuAZF0gPX+XaIZwaYDbT1w2L33UjxB+etdv2EG4Dtk8hgSBLVi0cgjvg=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:03.190014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2f2e1de1-840f-4080-9fe8-1b6902e7961c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1221 microversion: 2.1 time: 0.343865 Jul 20 21:53:03.192881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 16/29] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:02 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:03.233048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-ee65b577-5f8f-48ca-aa29-96170e234d4e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for project e722bb68652c48f588d8b53351c6f2a6. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:03.238512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-18dc0f44-0fc0-4032-9651-0ce25b5ee61f tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abab65550>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:03.245150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-ee65b577-5f8f-48ca-aa29-96170e234d4e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for user 60f7f43c067e4b819aeb488e9f09197a and project e722bb68652c48f588d8b53351c6f2a6. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:03.440246 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ee65b577-5f8f-48ca-aa29-96170e234d4e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.920673 Jul 20 21:53:03.456163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 14/30] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:53:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:03.578147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-18dc0f44-0fc0-4032-9651-0ce25b5ee61f tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 202 len: 0 microversion: 2.1 time: 0.358026 Jul 20 21:53:03.578147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 17/31] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:53:03 2022] DELETE /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:53:03.622309 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3791f201-d5e6-4e3d-b074-6f48875bf02b tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abcef3e50>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:03.627282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:03.634947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:03.653215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:03.655090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:03.656316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:03.657021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:03.797603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3791f201-d5e6-4e3d-b074-6f48875bf02b tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 200 len: 353 microversion: 2.1 time: 0.197473 Jul 20 21:53:03.807305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 15/32] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:53:03 2022] GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:03.839358 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-445555588", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:04.009227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] validate_networks() for [('3eef71be-0bf3-4fa0-b902-6d7954148e3f', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:53:04.239168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:04.274351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-93575847-b1ab-4212-a151-d556392fb353 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1219 microversion: 2.1 time: 0.654778 Jul 20 21:53:04.277135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 18/33] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:03 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1219 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:04.298180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:04.300279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:04.341763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:04.342249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:04.343054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:04.343511 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:04.667981 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:04.682688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-608fed59-960e-4b29-ad6f-96d0c5ce2264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1238 microversion: 2.1 time: 0.401503 Jul 20 21:53:04.684843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 19/34] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:04 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1238 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:04.820608 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8d8779d6-5469-46e7-8297-7fc09a841cea tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Calling method '.version_select at 0x7f6abaaeb1f0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:04.983480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-8d8779d6-5469-46e7-8297-7fc09a841cea tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] HTTP exception thrown: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8d8779d6-5469-46e7-8297-7fc09a841cea tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Request method failure captured: Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 HTTP/1.1 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk3hb2Gfz4tCNMXh2_fk1HhtT18V0PqRoKIhMse5NcCygRFF7k0IDDyrVluYZ-ZqAm7OlUTB62xom0JJVl9KQDysab8XhjZFvq3pURupRIsoHA_kgRmvZQS-pjngKU1TAcHp95oBdczZm_UuhGTc4p2P-b1DgoNM2iQAxBBjUYHDoo Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 948ccdc261db41feb6d0b34bc8c9e1a6 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesGetTestJSON-1829381092 Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:53:04.986001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/948ccdc261db41feb6d0b34bc8c9e1a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_948ccdc261db41feb6d0b34bc8c9e1a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/948ccdc261db41feb6d0b34bc8c9e1a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/948ccdc261db41feb6d0b34bc8c9e1a6"}]}] Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesGetTestJSON-1829381092 Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 948ccdc261db41feb6d0b34bc8c9e1a6 Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesGetTestJSON-1829381092 Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesGetTestJSON-1829381092-project Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: d93fa1bf91d54079b3e0a73436d749ce Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesGetTestJSON-1829381092-project Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'b1d20f4b-723d-408a-bc64-e9555e55ad85'} Jul 20 21:53:04.987450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. (HTTP 404) (Request-ID: req-46204cdc-f702-4418-8f7e-618e55d59161) Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:53:04.988334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 21:53:04.989550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 21:53:04.990710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8d8779d6-5469-46e7-8297-7fc09a841cea tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] Returning 404 to user: Volume b1d20f4b-723d-408a-bc64-e9555e55ad85 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8d8779d6-5469-46e7-8297-7fc09a841cea tempest-VolumesGetTestJSON-1829381092 tempest-VolumesGetTestJSON-1829381092-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85" status: 404 len: 109 microversion: 2.1 time: 0.173277 Jul 20 21:53:04.991785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 20/35] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 21:53:04 2022] GET /compute/v2.1/os-volumes/b1d20f4b-723d-408a-bc64-e9555e55ad85 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:53:05.293623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:05.295100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:05.304315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.305533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.306634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.307590 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.388480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:05.389521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:05.390216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:05.390792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:05.391387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:05.420664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.422661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.424659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.428259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.472386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:05.474621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:05.481073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for user 1a0d4ce0ac4d47c8a184ea0291461379 and project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:05.483790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1d1c2614-cf9c-4f35-b294-b9d15b5b0705 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1267 microversion: 2.1 time: 0.194383 Jul 20 21:53:05.484367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 21/36] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:05 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:05.513905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:05.526624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:05.676718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-02b75433-eb7e-4c67-a130-a8b5796cb992 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.863490 Jul 20 21:53:05.679107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 16/37] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:53:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:53:05.688626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-611aa6e2-6bf7-4af2-ae2d-72fe2ff5fcc3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:05.690238 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-611aa6e2-6bf7-4af2-ae2d-72fe2ff5fcc3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:05.702332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:05.703210 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:05.777499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.777962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.778779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:05.787297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:05.884031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-611aa6e2-6bf7-4af2-ae2d-72fe2ff5fcc3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:05.930255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-611aa6e2-6bf7-4af2-ae2d-72fe2ff5fcc3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1221 microversion: 2.1 time: 0.240927 Jul 20 21:53:05.934019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 22/38] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:05 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:06.289057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:06.340934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2cd26e3d-4b07-4524-8088-41f003ec64cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1294 microversion: 2.1 time: 0.643564 Jul 20 21:53:06.342738 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 17/39] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:05 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1294 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:06.503526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:06.506188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:06.520427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:06.521786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:06.525523 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:06.526886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:06.710610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:06.738399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9cfa68f7-a2d3-4f7d-bcbd-b4a2cac27478 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1267 microversion: 2.1 time: 0.239624 Jul 20 21:53:06.739702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 23/40] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:06 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:06.956519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:06.957142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:06.978063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:06.978527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:06.985890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:06.986782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:07.140334 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:07.157822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6e54edae-5654-4220-8878-f9c7919b0fdd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1225 microversion: 2.1 time: 0.206856 Jul 20 21:53:07.160678 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 18/41] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:06 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:07.362306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:07.365568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:07.388282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:07.388806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:07.389637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:07.390150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:07.759340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-702179228", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25cda20e-f9f2-497a-b842-ac835141a913"}], "security_groups": [{"name": "tempest-securitygroup--911633186"}], "key_name": "tempest-keypair-1779103835", "user_data": "}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:07.769422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:07.783032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d47f7a3d-972e-4a58-9efc-3555c667a779 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1294 microversion: 2.1 time: 0.423672 Jul 20 21:53:07.785054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 24/42] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:07 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1294 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:07.794959 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:07.800048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:07.812915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:07.813632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:07.814602 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:07.817505 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:07.976142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:07.992038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d7512ec1-4944-40dc-824a-713333572493 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1267 microversion: 2.1 time: 0.204195 Jul 20 21:53:07.996117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 25/43] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:07 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:08.187693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:08.188313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:08.201941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:08.205786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:08.214671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:08.215147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:08.262588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] validate_networks() for [('25cda20e-f9f2-497a-b842-ac835141a913', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:53:09.295394 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:09.307830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e28ad206-01e0-42be-8de3-df9ac2dfb999 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1225 microversion: 2.1 time: 1.124081 Jul 20 21:53:09.309257 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 26/44] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:08 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1225 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:09.325583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1527886508", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0780df8c-47a0-412c-9735-300eea6eaf13"}], "security_groups": [{"name": "tempest-securitygroup--603258102"}], "key_name": "tempest-keypair-2104392816", "user_data": "}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:10.511106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] validate_networks() for [('0780df8c-47a0-412c-9735-300eea6eaf13', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:53:11.089823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:11.333185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:11.334805 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:11.335710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:11.336268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:11.336842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:11.359394 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:11.360074 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:11.361032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:11.367412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:11.428857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:11.440664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for user fb27ee14314f42cc87e8e6bac2031c70 and project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:11.475763 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:11.483199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:11.634661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f9a6aefc-b074-4dbe-b0eb-e939e31a9fd2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.882141 Jul 20 21:53:11.635752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 19/45] 10.222.0.86 () {62 vars in 1187 bytes} [Wed Jul 20 21:53:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 3884 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 21:53:11.652145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:11.660120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:11.699559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:11.700378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:11.701355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:11.703573 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:12.014690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:12.029104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-071ff06b-766b-43c3-b6ab-637db22e9678 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1300 microversion: 2.1 time: 0.391942 Jul 20 21:53:12.033471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 20/46] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:11 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1300 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:12.056414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:12.064006 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:12.094124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:12.102444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:12.108395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:12.113990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:13.796880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:13.808955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-308709b9-1cda-4a42-8404-5122caff8027 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 1.774058 Jul 20 21:53:13.811160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 21/47] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:12 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:13.824972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:13.825919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:13.830478 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:13.860112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:13.862937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:13.874364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:13.875307 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:15.043425 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:15.053369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1c42d219-fa73-4ea4-bb3d-84c2f4a74d5e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 1.233299 Jul 20 21:53:15.061619 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 22/48] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:13 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:15.067008 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:15.091855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:15.128666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:15.129362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:15.131004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:15.137081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:15.924655 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=18 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:16.241449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:16.251572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:16.253492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:16.254879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6812577e-b44a-4e56-a6ca-24168ede924b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1339 microversion: 2.20 time: 1.192067 Jul 20 21:53:16.255769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 23/49] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:15 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1339 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:16.278196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:16.279570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:16.286347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:16.291805 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:16.293016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:16.293706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:17.184119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:17.198130 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d7400e58-88f9-46dd-9283-98447b695444 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1300 microversion: 2.1 time: 0.923907 Jul 20 21:53:17.210575 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 24/50] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:16 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1300 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:17.228448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:17.228448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:17.275693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:17.308725 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:17.309801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:17.310081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:18.376673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:18.377236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:18.377777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:18.378621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:18.378995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:18.401466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:18.411174 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:18.421114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:18.421853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:18.551791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for project e722bb68652c48f588d8b53351c6f2a6. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:18.571281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for user 60f7f43c067e4b819aeb488e9f09197a and project e722bb68652c48f588d8b53351c6f2a6. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:18.614224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:18.621084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:18.811544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-94abd287-07b2-4265-a76d-f555289a2f5e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 9.500750 Jul 20 21:53:18.814267 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 27/51] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:53:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 9504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:53:18.829714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:18.835958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:18.871550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:18.872108 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:18.878275 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:18.884630 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:18.962672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:18.971507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d6a004a5-b3b8-43db-878f-69e3fdf404c6 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 1.769477 Jul 20 21:53:18.972230 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 25/52] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:17 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:19.507379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-23c5637d-fa63-4061-b94c-09c2e8e7d697 req-bfc82341-4cee-4cee-807d-e497aa8eec2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9bf4672-424a-4c1d-adf8-379c0406c751", "tag": "d3f6ee20-eed2-4116-a54e-d4abfce56f7f"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:19.533991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-23c5637d-fa63-4061-b94c-09c2e8e7d697 req-bfc82341-4cee-4cee-807d-e497aa8eec2a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.534878 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-23c5637d-fa63-4061-b94c-09c2e8e7d697 req-bfc82341-4cee-4cee-807d-e497aa8eec2a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.560238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-23c5637d-fa63-4061-b94c-09c2e8e7d697 req-bfc82341-4cee-4cee-807d-e497aa8eec2a service nova] Creating event network-changed:d3f6ee20-eed2-4116-a54e-d4abfce56f7f for instance f9bf4672-424a-4c1d-adf8-379c0406c751 on hv-cinder-84969 Jul 20 21:53:19.561056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-23c5637d-fa63-4061-b94c-09c2e8e7d697 req-bfc82341-4cee-4cee-807d-e497aa8eec2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 21:53:19.562185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.562772 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.563702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.564242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.580336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.compute.rpcapi [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 21:53:19.582265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] Releasing lock "compute-rpcapi-router" {{(pid=124150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 21:53:19.583859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:19.606141 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e5dde8b7-f279-4e15-adf4-a29d74242de7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.790134 Jul 20 21:53:19.611715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bf8a6fb6-2355-452d-a73c-5dd3bc7f254a None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.634022 Jul 20 21:53:19.614324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 28/54] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:18 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:19.624414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 26/54] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:19.625702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:19.626620 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:19.637454 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:19.643402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.643639 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:19.643735 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.646435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.647004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.659956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.660709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:19.662113 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:19.662870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.085558 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.095999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.102333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b0a0a66f-0898-47d9-9e13-7aadd20dd81c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.476439 Jul 20 21:53:20.113164 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 27/55] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:19 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:20.117454 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.118882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:20.119654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.119985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:20.123828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-39c825d9-f924-4283-b9a2-f7ff01acb449 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.503150 Jul 20 21:53:20.125122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 29/56] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:19 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:20.131937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:20.134068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:20.136739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.137602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.143675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.143871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.144452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.144597 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.145253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.145730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.273664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.290475 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9df3b967-9dc7-4321-9aa4-3c623bd985cc tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.175550 Jul 20 21:53:20.291719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 28/57] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:20 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:20.373964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.383691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f4d76ad9-8c3e-4c15-83bc-b1787704a2bc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.256818 Jul 20 21:53:20.384289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 30/58] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:20 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:20.633419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:20.634086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:20.643602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.644060 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.644979 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:20.645419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:20.814369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:20.836799 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-45fefc3a-aaca-489c-aa6c-7dad6c63be75 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.208364 Jul 20 21:53:20.840562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 29/59] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:20 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:21.138292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:21.146047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:21.146901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:21.149135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:21.159915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.160333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.160895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.161073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.162560 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.162739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.164007 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.165899 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.412351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.423924 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f21bd13f-a25c-4e4c-a9d3-e02433c09a79 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.291600 Jul 20 21:53:21.429048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 31/60] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:21 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:21.434699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:21.438182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:21.447749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.448548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.449705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.450326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.468935 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=28 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:21.504223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.516775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.527410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.530144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e013d3bd-8e10-44d6-97c6-0e4941ec070d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.389441 Jul 20 21:53:21.532965 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 30/61] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:21 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:53:21.541335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:21.545874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:21.557956 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.560278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.561128 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.563612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.564889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.568776 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-95d02ac5-b5d1-4c41-871b-101027ed7d1f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.137520 Jul 20 21:53:21.595241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 32/62] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:21 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:21.657378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-0c2f3755-07c5-4a40-a335-43aef24da927 req-c4d05ea1-2993-4009-8033-671cee58dedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d0a71d-30e3-4ae7-9d30-76cf661b37ad", "tag": "f62b1e8c-e6cf-4283-835b-52bdd104f80f"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:21.732075 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0c2f3755-07c5-4a40-a335-43aef24da927 req-c4d05ea1-2993-4009-8033-671cee58dedf service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.736651 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0c2f3755-07c5-4a40-a335-43aef24da927 req-c4d05ea1-2993-4009-8033-671cee58dedf service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.832760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-0c2f3755-07c5-4a40-a335-43aef24da927 req-c4d05ea1-2993-4009-8033-671cee58dedf service nova] Creating event network-changed:f62b1e8c-e6cf-4283-835b-52bdd104f80f for instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad on hv-cinder-84969 Jul 20 21:53:21.835301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0c2f3755-07c5-4a40-a335-43aef24da927 req-c4d05ea1-2993-4009-8033-671cee58dedf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 21:53:21.838451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.839467 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.840973 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.841946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.894593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:21.897540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.compute.rpcapi [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 21:53:21.899979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] Releasing lock "compute-rpcapi-router" {{(pid=124151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 21:53:21.912582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ad078084-1888-42e4-8a6c-2c951b5a3b78 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.376364 Jul 20 21:53:21.938814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 31/63] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:21 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:21.950161 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:21.951638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:21.962913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c2768f2d-dd80-4fd6-8e2a-54f2e52af54a None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312882 Jul 20 21:53:21.964153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 33/64] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:53:21.970992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.971904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:21.973306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:21.974569 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.318727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:22.334761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-83678097-6b1b-4dfe-a6b5-66859e6e8739 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.392038 Jul 20 21:53:22.345593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 32/65] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:21 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:22.457928 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:22.459359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:22.471992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.472452 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.473236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.473672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.561251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:22.562083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:22.576313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.584915 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.585142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.596319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.628803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:22.836632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:22.857179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3ed93cf7-c6ed-46b1-af79-0a898e265bc1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.411165 Jul 20 21:53:22.861913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 34/66] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:22 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:22.870048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:22.870933 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:22.908839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.925020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:22.925415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:22.926005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.077101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:23.090917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:23.092838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:23.093541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:23.095335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f26c7c7b-a63b-4f51-995b-616fe5a3e1b3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.538536 Jul 20 21:53:23.097027 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:22 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:23.103427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fa9d1ee5-9f51-4a24-ba77-8bcddf36d417 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.240330 Jul 20 21:53:23.111165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 35/68] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:22 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:23.118845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:23.120856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:23.139918 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.140503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.141344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.141781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.360362 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:23.362372 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:23.379441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.379914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.381424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.381894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.479735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:23.495527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a687c6c6-3e36-4840-ae33-76035898feaf tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.396607 Jul 20 21:53:23.496148 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 34/69] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:23 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:23.887756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:23.889152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:23.922365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.926212 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:23.928886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:23.932504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.301414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.315536 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-332efd58-ec12-4125-b780-b9afcc3ae039 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.432036 Jul 20 21:53:24.316232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 35/70] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:23 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:24.323182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.331675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d312cb23-0a50-4e62-b546-9fafefab8e33 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.983435 Jul 20 21:53:24.340023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 36/71] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:23 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:24.349881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:24.350111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:24.351185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:24.363902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:24.385403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.386142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.386366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.387265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.387807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.394527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.396405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.422364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.424133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.526707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.535018 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7a413ae7-71c2-4e2d-ab4f-62b872c491e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.193694 Jul 20 21:53:24.544878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 37/72] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:24 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:24.553434 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:24.563131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:24.581685 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.584866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.585619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.586887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:24.587658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:24.822201 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.835732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.843232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.844456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-eb2f83a5-5fd7-45b7-b00d-8bc0dc1a62c0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.526976 Jul 20 21:53:24.845167 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 36/73] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:24 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:24.845668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:24.860244 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-51281e0b-e98e-4b3b-adcb-4f33e944f582 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.312776 Jul 20 21:53:24.864814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 38/74] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:24 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:25.335577 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:25.339189 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:25.343026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.343504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.344290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.344720 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.351958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:25.353352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:25.366850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.368830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.369742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.370319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.588030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:25.590935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:25.596661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3d184cc6-31f3-4224-94a5-7e302245f323 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.265587 Jul 20 21:53:25.600946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8c0a5ad2-7521-4f07-8858-8e5ce5a16a59 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.254081 Jul 20 21:53:25.608458 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 37/75] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:25 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:25.611477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 39/76] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:25 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:25.613975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:25.615373 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:25.623442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.623900 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.624840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.625441 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.701129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:25.708880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5e13fbac-f4f7-4be3-b95a-e171c2d754d6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.098690 Jul 20 21:53:25.709540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 38/77] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:25 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:25.868701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:25.870118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:25.884951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.884951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.884951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.884951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.894465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:25.895190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:25.902047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.902639 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:25.903851 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:25.904503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.115343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.118581 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.125382 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.126694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-813eec71-6965-4c83-8673-bb375663b992 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.240384 Jul 20 21:53:26.127986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.129128 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-72ecf81e-8173-4d4a-a258-4a1514587623 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.267238 Jul 20 21:53:26.129693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 40/78] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:25 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:26.134884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 39/79] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:25 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:26.615867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:26.616494 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:26.622522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:26.623306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:26.626546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.627408 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.629746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.629892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.630834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.631554 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.631770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.632271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.836080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.843881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.854163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-15930511-0bde-47c3-89f6-d8a310bc3037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.235634 Jul 20 21:53:26.854296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7149beae-3d73-4889-9130-49ce0b4b3e9e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.242255 Jul 20 21:53:26.855302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 40/80] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:26 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:26.860263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:26.860996 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:26.864115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 41/81] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:26 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:26.868434 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.869082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.869962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:26.870532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:26.937027 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:26.945894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4f22a5f1-6574-4b33-8c5c-bd6d75228666 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1242 microversion: 2.1 time: 0.089441 Jul 20 21:53:26.947041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 41/82] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:26 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:27.145617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:27.146232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:27.148269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:27.149091 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:27.152797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.153565 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.154004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.154595 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.155914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.156746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.157991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.158530 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.384606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:27.396808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:27.397704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1a71697e-7882-46b6-9687-3e025d0c133b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.257390 Jul 20 21:53:27.403417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 42/83] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:27 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:27.407550 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:27.409081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:27.410254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-76cd769e-f5b2-48b2-9196-21ca75336ce1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.266397 Jul 20 21:53:27.410807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 42/84] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:27 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:27.874998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:27.877209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:27.880839 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:27.881648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:27.886932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.887665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.888594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.889193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.894776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.896854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:27.901715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:27.903087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:28.594749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:28.896040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:28.912381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ab11ed75-13e3-4292-8e5d-600d3d188728 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 1.043588 Jul 20 21:53:28.936856 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 43/85] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:27 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:28.944358 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:28.945425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:28.953377 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:28.953377 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:28.954432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:28.955197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:28.983087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:28.994402 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-98af2172-e44d-47b8-912f-539eab454526 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 1.117993 Jul 20 21:53:28.995844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 43/86] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:27 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:29.002398 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:29.009171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:29.009523 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.009986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:29.011005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.011332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:29.134032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:29.145646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e0c1a9dd-557c-4f66-a6e5-0ccc65283967 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1298 microversion: 2.1 time: 0.207703 Jul 20 21:53:29.147442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 44/87] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:28 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1298 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:29.167165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:29.172163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:29.195556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.196341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:29.197721 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.200405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:29.468634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:29.490460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-534c6c8f-7550-485c-b140-4af769d66bcc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.491734 Jul 20 21:53:29.491893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 44/88] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:28 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:29.935881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:29.946571 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:29.948342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:29.956526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:29.964980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=10 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:29.970708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:29.974242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.974660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:29.976549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6a8ae838-151f-44c4-a4db-ef0308809629 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.825150 Jul 20 21:53:29.979602 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 45/89] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:29 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:29.982045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:29.983982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:30.012527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:30.018762 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:30.049526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:30.062964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:30.069383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:30.070899 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:30.729465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:30.750687 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c0877980-d443-4354-ab4b-859653818295 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.808684 Jul 20 21:53:30.771619 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 45/90] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:29 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:30.777740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:30.778374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:30.796009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:30.796514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:30.797361 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:30.797801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:31.019286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:31.037997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fcf683f7-32a4-43e7-bb4f-b66483c56bb8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1296 microversion: 2.1 time: 0.265106 Jul 20 21:53:31.042004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 46/91] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:30 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1296 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:31.052206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:31.062237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-df799d15-733f-4f2f-b4a4-dd0b9ba16ca5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 1.053750 Jul 20 21:53:31.064103 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 46/92] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:30 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:31.078907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:31.080720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:31.096375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:31.097691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:31.097803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:31.100344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:31.101476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:31.104832 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:31.107533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:31.108712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:31.110251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:31.110769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:31.889947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:32.485673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:32.502631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cf587d29-2c9f-4de3-96ee-73012b8fda65 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 1.458014 Jul 20 21:53:32.504880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 47/93] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:31 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:32.525341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:32.525971 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:32.533855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:32.534696 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:32.535699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:32.536521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:32.657774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:32.678115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:32.680973 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:32.683396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-83d43324-dd6c-4d73-91c9-241092ccc0a1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 1.617973 Jul 20 21:53:32.684156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 47/94] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:31 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:32.690007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:32.692536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:32.700872 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:32.701733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:32.702690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:32.703641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.253563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.265694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c06fe4b6-a030-4b97-89be-636c68c5267b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.752117 Jul 20 21:53:33.267695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 48/95] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:32 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:33.275001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:33.276782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:33.285181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.285922 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.289207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.289827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.324892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.340587 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1a1a1745-0654-452c-b0aa-104d2db6f83b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.654760 Jul 20 21:53:33.341236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 48/96] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:32 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:33.423996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-70b49a40-8de8-4779-8cd0-b3e4bdaaafc9 req-3ac229de-6226-427b-bf9b-00351171aa80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ae5df2-b95e-4408-94a0-c75f87543061", "tag": "dade829a-03be-4cdc-9c12-e945626cdbe0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:33.434708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-70b49a40-8de8-4779-8cd0-b3e4bdaaafc9 req-3ac229de-6226-427b-bf9b-00351171aa80 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.435452 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-70b49a40-8de8-4779-8cd0-b3e4bdaaafc9 req-3ac229de-6226-427b-bf9b-00351171aa80 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.453019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-70b49a40-8de8-4779-8cd0-b3e4bdaaafc9 req-3ac229de-6226-427b-bf9b-00351171aa80 service nova] Creating event network-changed:dade829a-03be-4cdc-9c12-e945626cdbe0 for instance 18ae5df2-b95e-4408-94a0-c75f87543061 on hv-cinder-84969 Jul 20 21:53:33.460911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-70b49a40-8de8-4779-8cd0-b3e4bdaaafc9 req-3ac229de-6226-427b-bf9b-00351171aa80 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117445 Jul 20 21:53:33.461729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 49/97] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:33.474520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-c559e137-02f3-4f9e-8cb0-33d25fd67ff7 req-516a1bb6-a42e-460d-a4d1-1b3db5eb71f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd54893a-7604-4639-97b3-049128aac78b", "tag": "18e13523-1791-4e22-bd94-50f9617505c0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:33.484527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c559e137-02f3-4f9e-8cb0-33d25fd67ff7 req-516a1bb6-a42e-460d-a4d1-1b3db5eb71f4 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.485244 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c559e137-02f3-4f9e-8cb0-33d25fd67ff7 req-516a1bb6-a42e-460d-a4d1-1b3db5eb71f4 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.500456 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-c559e137-02f3-4f9e-8cb0-33d25fd67ff7 req-516a1bb6-a42e-460d-a4d1-1b3db5eb71f4 service nova] Creating event network-changed:18e13523-1791-4e22-bd94-50f9617505c0 for instance cd54893a-7604-4639-97b3-049128aac78b on hv-cinder-84969 Jul 20 21:53:33.507428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-c559e137-02f3-4f9e-8cb0-33d25fd67ff7 req-516a1bb6-a42e-460d-a4d1-1b3db5eb71f4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043602 Jul 20 21:53:33.508931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 50/98] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:33.542553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.551330 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-336a3884-e53e-4533-8290-85ab43c7b112 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.281550 Jul 20 21:53:33.552043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 49/99] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:33 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:33.557868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:33.558833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:33.566016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.566507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.567933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.568376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.572877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.591966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-28193a45-5f68-4709-b2a4-27519c26b285 req-632b8d3f-326d-4e98-a9fb-9b2ebfa9c2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bf4672-424a-4c1d-adf8-379c0406c751", "name": "network-vif-plugged", "status": "completed", "tag": "d3f6ee20-eed2-4116-a54e-d4abfce56f7f"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:33.608523 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-28193a45-5f68-4709-b2a4-27519c26b285 req-632b8d3f-326d-4e98-a9fb-9b2ebfa9c2ca service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.609315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-28193a45-5f68-4709-b2a4-27519c26b285 req-632b8d3f-326d-4e98-a9fb-9b2ebfa9c2ca service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.625318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-28193a45-5f68-4709-b2a4-27519c26b285 req-632b8d3f-326d-4e98-a9fb-9b2ebfa9c2ca service nova] Creating event network-vif-plugged:d3f6ee20-eed2-4116-a54e-d4abfce56f7f for instance f9bf4672-424a-4c1d-adf8-379c0406c751 on hv-cinder-84969 Jul 20 21:53:33.632179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-28193a45-5f68-4709-b2a4-27519c26b285 req-632b8d3f-326d-4e98-a9fb-9b2ebfa9c2ca service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116728 Jul 20 21:53:33.633093 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 51/100] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:33.706892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:33.712047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:33.728182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.731795 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.732803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.734007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:33.734545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:33.737453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4b4444af-bd04-4c76-b56d-caee66399dd3 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.184211 Jul 20 21:53:33.747870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 50/101] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:33 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:33.936118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.949036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.952761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:33.955829 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e40efb28-633c-4684-8266-b5b607bf2f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.257576 Jul 20 21:53:33.956433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 52/102] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:33 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:53:34.288836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:34.289626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:34.304713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:34.305779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:34.307616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:34.308093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:34.359363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:34.360364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:34.373701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:34.374360 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:34.378557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:34.380069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.185568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.194672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c81b2ad7-6150-4954-9b03-ebaa6d7529d1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.913616 Jul 20 21:53:35.195273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 51/103] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:34 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:35.202285 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:35.203089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:35.210710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.211253 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.212034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.212679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.236604 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.247834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7554f91f-dce6-456d-8d65-de07de8cf0f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.892720 Jul 20 21:53:35.248431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 53/104] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:34 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:35.256249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:35.257216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:35.264664 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.264664 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.265539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.265993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.587574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.587990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.599832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d9ff2875-ca66-4828-963e-6a25a68e7685 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.402453 Jul 20 21:53:35.602153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 52/105] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:35 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:35.615160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:35.619767 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:35.623042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.623516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.624275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.624703 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.627261 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2a628a7b-6264-447d-9075-fdcbaa47f137 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.377526 Jul 20 21:53:35.629188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 54/106] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:35 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:35.638449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}, {"name": "network-changed", "server_uuid": "5a027718-c5db-48a7-bafd-4b4130e2380a", "tag": "ded61c9e-a55f-4fb8-8822-17313fc2edcf"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:35.645756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:35.646210 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:35.663547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] Creating event network-changed:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:53:35.664206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] Creating event network-changed:ded61c9e-a55f-4fb8-8822-17313fc2edcf for instance 5a027718-c5db-48a7-bafd-4b4130e2380a on hv-cinder-84969 Jul 20 21:53:35.671431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-291981c3-2938-4628-b065-cc2bc030e37f req-3372f410-f3cc-430d-ada0-741135cacc96 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040868 Jul 20 21:53:35.671911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 55/107] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:35.787744 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.804248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.805773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:35.807143 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-437b22c8-0d76-47d3-b908-a5c73a745aac tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.203851 Jul 20 21:53:35.818240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 53/108] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:35 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:36.214519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:36.214519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:36.220658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.221112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.221888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.222323 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.241161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:36.270207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:36.270207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:36.272871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.273337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.274123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.274565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.450575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:36.459539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4a41dbdb-e3d2-4089-83ce-a87661918474 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.250102 Jul 20 21:53:36.460723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 56/109] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:36 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:36.474987 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:36.485566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-813d30fb-0137-4169-8cda-224b64924017 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.223632 Jul 20 21:53:36.486165 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 54/110] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:36 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:36.620554 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:36.621172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:36.627631 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.628076 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.628851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.629271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.646588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:36.647511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:36.654885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.655719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.656584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.657247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.879133 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:36.888684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:36.889407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a9727acb-e21e-4bcc-9cd8-e4ec875e1fa0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.275121 Jul 20 21:53:36.890009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 57/111] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:36 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:36.896550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:36.897215 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a5c528a5-2459-445a-b9f2-5929b1d7da1f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.255178 Jul 20 21:53:36.897347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:36.901713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 55/112] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:36 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:36.903334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.903790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:36.905172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:36.905797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.105141 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:37.115367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:37.120017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:37.122431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a7567508-71bd-4961-b45d-94e64e507ff8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.231277 Jul 20 21:53:37.136356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 58/113] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:36 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:37.484590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:37.487502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:37.497505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.498176 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.499360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.500090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.506230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:37.507671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:37.533143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.534220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.535033 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.535501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.740547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:37.744663 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:37.748953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-34c2fcca-0b02-4d3c-84ef-592626a367c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.275640 Jul 20 21:53:37.749493 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 56/114] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:37 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:37.757111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-af9deea6-4e24-43a5-a853-ef5ac8c88f73 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.253215 Jul 20 21:53:37.759247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 59/115] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:37 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:37.905947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:37.906555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:37.913334 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.913779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.914540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.914967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.917994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:37.919142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:37.929235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.929601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:37.930384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:37.930814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.143492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:38.149288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:38.151797 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4a03dc84-b5c4-4701-b874-9b4c6a0ef515 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.249614 Jul 20 21:53:38.152383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 57/116] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:37 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:38.157172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:38.157641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-16793f23-c400-4608-8791-d2915cadb23a tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.247005 Jul 20 21:53:38.157911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:38.158464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 60/117] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:37 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:38.173415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.174022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.174789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.175254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.341724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:38.357329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:38.359120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:38.360336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1912a50c-e540-4574-ab93-aec05981fe82 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.206725 Jul 20 21:53:38.360914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 58/118] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:38 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:38.766384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:38.768403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:38.774836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:38.775593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:38.786464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.787106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.787488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.787994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.788714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.789017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:38.790124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:38.790729 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.029556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.037453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.048074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6a9a6597-9e24-46a4-8671-b895a0298447 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.285757 Jul 20 21:53:39.048758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 61/119] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:38 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:39.055110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-49b4d752-c6fa-4ba9-9451-33f79b42ce09 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.285046 Jul 20 21:53:39.062335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 59/120] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:38 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:39.168914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:39.169625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:39.174405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:39.175417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:39.176466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.177019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.177867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.178379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.183692 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.184405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.185207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.185644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.475199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.480120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.490480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-135e3237-260d-4686-ba56-96bd4036a04c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.318360 Jul 20 21:53:39.492254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 60/121] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:39 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:39.501286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-e9f8abcf-85de-4415-a506-207ee8a35845 req-4e5dfdc2-01b5-4f55-ba13-10e17a632cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d0a71d-30e3-4ae7-9d30-76cf661b37ad", "name": "network-vif-plugged", "status": "completed", "tag": "f62b1e8c-e6cf-4283-835b-52bdd104f80f"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:39.505785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-968012cc-1d13-479c-be6e-ba10241fdfae tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.339794 Jul 20 21:53:39.513376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 62/122] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:39 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:39.534817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e9f8abcf-85de-4415-a506-207ee8a35845 req-4e5dfdc2-01b5-4f55-ba13-10e17a632cd9 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.535592 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e9f8abcf-85de-4415-a506-207ee8a35845 req-4e5dfdc2-01b5-4f55-ba13-10e17a632cd9 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.543575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:39.544636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:39.555975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.556681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.558079 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:39.558734 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:39.563467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-e9f8abcf-85de-4415-a506-207ee8a35845 req-4e5dfdc2-01b5-4f55-ba13-10e17a632cd9 service nova] Creating event network-vif-plugged:f62b1e8c-e6cf-4283-835b-52bdd104f80f for instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad on hv-cinder-84969 Jul 20 21:53:39.576090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-e9f8abcf-85de-4415-a506-207ee8a35845 req-4e5dfdc2-01b5-4f55-ba13-10e17a632cd9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080986 Jul 20 21:53:39.576836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 61/123] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:39.939878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.962556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.964696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:39.966248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-71264fec-d40f-4474-b8a3-4d62693bb4c5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.450678 Jul 20 21:53:39.968514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 63/124] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:39 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:40.073499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:40.075098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:40.093375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:40.094062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:40.098574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.099652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.101112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.101791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.102839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.103249 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.103728 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.104704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.490400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:40.494283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:40.498540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4048d17b-437d-454b-998e-cbf7967ff268 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.432038 Jul 20 21:53:40.499581 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 62/125] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:40 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:40.505535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b60a5e8f-4879-4631-b9bb-08b045ca3ca7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.435652 Jul 20 21:53:40.506122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 64/126] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:40 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:40.521521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:40.522124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:40.528726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.529097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.529648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:40.529880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.530306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.530405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:40.540120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.540120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.540120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:40.540120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:40.733153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:40.744376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e62ff280-86ba-4ab2-aaac-7d6b6aa0a2d5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1315 microversion: 2.1 time: 0.227212 Jul 20 21:53:40.745350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:40.746911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 63/127] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:40 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:40.754172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cd6abfdf-52d5-4903-a489-1c6c99b09b94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.228374 Jul 20 21:53:40.759204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 65/128] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:40 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:40.986667 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:40.987327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:41.013695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.014544 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.014991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.015472 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.320110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:41.330948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:41.333907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:41.334803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4d1fbfdc-36ba-4373-8ec4-b4e2e61ef5e6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.352137 Jul 20 21:53:41.335407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 64/129] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:40 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:41.517537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:41.518775 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:41.522680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:41.523467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:41.533204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.533670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.534466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.534705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.534902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.538161 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.541066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:41.541659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:41.968733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:41.983488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:41.985873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2668d09c-954e-44d2-b4cf-a8831c1d3445 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.467935 Jul 20 21:53:41.999389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 65/130] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:41 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:42.006396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:42.006789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-10223b10-b7a4-49cb-8858-f1a668794264 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.494600 Jul 20 21:53:42.007872 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:42.008895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 66/131] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:41 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:42.014321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:42.014771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.015522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:42.016817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.018180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.018797 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.025890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.026852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.027979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.028850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.452549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:42.460840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-be171431-3893-48a6-bc9a-30adb2ff66f9 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1502 microversion: 2.1 time: 0.459954 Jul 20 21:53:42.468179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:42.473139 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 66/132] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:41 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1502 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:42.477665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-98aece97-6d2c-4238-b67f-1a6486606bcc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1321 microversion: 2.1 time: 0.467464 Jul 20 21:53:42.479110 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 67/133] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:42 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:42.479871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-95a1ca29-60b0-4433-837f-19f330c876b4 req-23d640f6-709c-4363-8d5c-254fd5d988bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd54893a-7604-4639-97b3-049128aac78b", "name": "network-vif-plugged", "status": "completed", "tag": "18e13523-1791-4e22-bd94-50f9617505c0"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:42.489951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-95a1ca29-60b0-4433-837f-19f330c876b4 req-23d640f6-709c-4363-8d5c-254fd5d988bd service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.490717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-95a1ca29-60b0-4433-837f-19f330c876b4 req-23d640f6-709c-4363-8d5c-254fd5d988bd service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.491456 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:42.493671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:42.502465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.503362 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.503929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-95a1ca29-60b0-4433-837f-19f330c876b4 req-23d640f6-709c-4363-8d5c-254fd5d988bd service nova] Creating event network-vif-plugged:18e13523-1791-4e22-bd94-50f9617505c0 for instance cd54893a-7604-4639-97b3-049128aac78b on hv-cinder-84969 Jul 20 21:53:42.505366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:42.506219 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:42.510604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-95a1ca29-60b0-4433-837f-19f330c876b4 req-23d640f6-709c-4363-8d5c-254fd5d988bd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035806 Jul 20 21:53:42.513252 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 67/134] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:42.686916 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:42.696459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:42.697983 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:42.699221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cfe05afa-7ec6-4d6d-9a7e-f9021a4446ae tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.218447 Jul 20 21:53:42.699806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 68/135] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:42 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:43.005822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:43.007095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.014804 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.015466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.016660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.019834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.024013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:43.024892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.026842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:43.033075 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.033601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.034415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.034979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.267288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.275362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-77110b73-5427-40dc-a584-297b34afab42 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.274354 Jul 20 21:53:43.276235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 68/136] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:42 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:43.286665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.295153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2bc5acd3-3f81-46bc-8803-6829647704fd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.274867 Jul 20 21:53:43.306049 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 69/137] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:43 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:43.495531 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:43.496122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.502560 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.503017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.503871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.504273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.699030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.706715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-943110b3-1af2-4b70-a365-38a438ace5b1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1515 microversion: 2.1 time: 0.215269 Jul 20 21:53:43.707384 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 69/138] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:43 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:43.720571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:43.721182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.724693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:43.725707 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.730341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.730866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.731742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.732250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.732348 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.732773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.733555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.733993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.804899 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'flavor' on Instance uuid a0d0a71d-30e3-4ae7-9d30-76cf661b37ad {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:53:43.945811 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.954756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.956439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:43.957709 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ba914152-e90e-4d29-988d-b964bd2c976a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.243126 Jul 20 21:53:43.960047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 70/139] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:43 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:43.968365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-54b31c7c-eddf-49cd-8186-3ec5234b6043 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad/action" status: 200 len: 32 microversion: 2.1 time: 0.247021 Jul 20 21:53:43.969489 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 70/140] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:53:43 2022] POST /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 21:53:43.978327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:43.978931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:43.984911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.985359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:43.986147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:43.986576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.133993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:44.141878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7781de45-8461-4204-bf10-ea2a9796e7f2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.167423 Jul 20 21:53:44.142468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 71/141] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:43 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:44.293665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:44.294841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:44.296447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=97 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:44.309982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.310744 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.311861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.312571 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.313736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:44.315173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:44.322060 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.323401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.324197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.324634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.587013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:44.595583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-83855e91-f7a4-4d65-b97e-3baa7e56042a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.285395 Jul 20 21:53:44.596168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 72/142] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:44 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:44.601080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:44.601613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-277d3ad4-b2ae-40a8-a86a-c9f58f017ad2 req-c89716ec-bd74-491d-be1f-ebc9c2daf616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "name": "network-vif-plugged", "status": "completed", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:44.611137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a0077220-02d2-4548-891a-0857096e07d5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.321901 Jul 20 21:53:44.611471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-277d3ad4-b2ae-40a8-a86a-c9f58f017ad2 req-c89716ec-bd74-491d-be1f-ebc9c2daf616 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.612007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-277d3ad4-b2ae-40a8-a86a-c9f58f017ad2 req-c89716ec-bd74-491d-be1f-ebc9c2daf616 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.619403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:44.622531 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 71/143] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:44 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:44.629131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-277d3ad4-b2ae-40a8-a86a-c9f58f017ad2 req-c89716ec-bd74-491d-be1f-ebc9c2daf616 service nova] Creating event network-vif-plugged:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:53:44.635022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-277d3ad4-b2ae-40a8-a86a-c9f58f017ad2 req-c89716ec-bd74-491d-be1f-ebc9c2daf616 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037675 Jul 20 21:53:44.636070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 73/144] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:44.978308 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:44.979017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:44.985279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.985735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:44.986519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:44.986956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.162646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:45.163535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:45.170255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.170704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.171521 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.171954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.192749 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.224395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.236005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.236923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4b0efb75-ba80-4a5c-9347-afbe145a0882 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.262621 Jul 20 21:53:45.237490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 72/145] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:44 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:45.336646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.344663 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-04bd3cd0-8033-4ad6-a120-1e2af0d76eac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.188076 Jul 20 21:53:45.345258 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 74/146] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:45 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:45.613139 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:45.613791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:45.620781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.621357 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.622312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.622851 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.634166 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:45.634890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:45.641893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.642875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.643890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:45.644498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:45.854896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.861402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:45.862883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-772e0600-a1a1-415f-b6a8-6c503b5e417c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.253472 Jul 20 21:53:45.863498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 73/147] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:45 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:45.870261 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2dc26ea6-bca6-43a5-b481-a443d1adf724 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.242753 Jul 20 21:53:45.871107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 75/148] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:45 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:46.046171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "212a278c-ae53-4e34-ac78-79d45cc55c96"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:46.047314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:46.053998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.054452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.055298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.055723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.256619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:46.257331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:46.263640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.264181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.265035 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.265645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.439235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:46.448591 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:46.450420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:46.459328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e3783a90-43e4-4b18-af20-d8431801501a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.198867 Jul 20 21:53:46.459328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 76/149] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:46 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:53:46.459328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:46.459328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:46.466348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.466803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.467604 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.468044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.676468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:46.684286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-87455d03-69ea-492d-9bfa-d45c56b1b05e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.230974 Jul 20 21:53:46.685039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 77/150] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:46 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:46.889836 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:46.890702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:46.908328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.908328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:46.912354 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:46.913056 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.154042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.163568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f9744b17-efc9-4eba-9b04-1730f615b085 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.284332 Jul 20 21:53:47.164250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 78/151] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:46 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:47.169324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:47.171053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:47.178618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.179261 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.180009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.180448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.352225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.360485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a6ddea87-a7a3-4fb0-998f-ae0463d23ba4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.194886 Jul 20 21:53:47.361164 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 79/152] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:47 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:47.473854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:47.474468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:47.480618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.481131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.481901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.482329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.636994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.646072 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.647501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.648624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-34d6c3b2-e90e-4337-9ed9-02f8eea9bb02 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.178788 Jul 20 21:53:47.649193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 80/153] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:47 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:53:47.701676 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:47.702474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:47.709954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.710540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.711560 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:47.712176 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:47.866819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:47.874724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b67ae0bc-4b11-4f53-8054-51c72ce5103e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.177012 Jul 20 21:53:47.875495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 81/154] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:47 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:48.180895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:48.181507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:48.187614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.188066 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.189296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.325363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:48.335014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5aaf4faa-7e82-42d3-bd8f-687a7bd634c9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.157665 Jul 20 21:53:48.336361 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 82/155] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:48 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:48.378818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:48.379978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:48.386264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.386708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.387495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.387923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.519581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:48.527580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-41dfcf10-ea5d-43da-9f1c-b86a25ae007c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.152573 Jul 20 21:53:48.528163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 83/156] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:48 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:48.668000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:48.668613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:48.674846 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.675326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.676100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.676558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.812054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:48.820831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:48.822332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:48.823460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2e9a97a4-b79c-48fd-8038-e8383267e729 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.159473 Jul 20 21:53:48.824017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 84/157] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:48 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:53:48.892563 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:48.893192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:48.901682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.901682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:48.902234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:48.903403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.137102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-943337f8-ea38-478e-ba1d-bad59f478217 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "POST /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.094611 Jul 20 21:53:49.137775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 74/158] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:53:46 2022] POST /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751/os-volume_attachments => generated 194 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:49.356175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:49.356882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:49.363577 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.364860 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.365622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.366118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.416073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:49.424741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-36400277-4cc5-4ace-8bb3-5c89c94eeb51 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.536130 Jul 20 21:53:49.425451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 85/159] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:48 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:49.544313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:49.544925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:49.552393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.553068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.554004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.554585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.840246 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:49.849519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6ea53586-c808-46b5-97ef-7d3d9a6beaad tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.497985 Jul 20 21:53:49.850097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 75/160] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:49 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:49.870944 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-4aa8f5f2-590b-4c21-8da9-d872b3d838b7 req-01d2d26a-58d5-4802-8c78-07c57bc42b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ae5df2-b95e-4408-94a0-c75f87543061", "name": "network-vif-plugged", "status": "completed", "tag": "dade829a-03be-4cdc-9c12-e945626cdbe0"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:49.885064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-4aa8f5f2-590b-4c21-8da9-d872b3d838b7 req-01d2d26a-58d5-4802-8c78-07c57bc42b9b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.885981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-4aa8f5f2-590b-4c21-8da9-d872b3d838b7 req-01d2d26a-58d5-4802-8c78-07c57bc42b9b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.902328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:49.904142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-4aa8f5f2-590b-4c21-8da9-d872b3d838b7 req-01d2d26a-58d5-4802-8c78-07c57bc42b9b service nova] Creating event network-vif-plugged:dade829a-03be-4cdc-9c12-e945626cdbe0 for instance 18ae5df2-b95e-4408-94a0-c75f87543061 on hv-cinder-84969 Jul 20 21:53:49.911761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-4aa8f5f2-590b-4c21-8da9-d872b3d838b7 req-01d2d26a-58d5-4802-8c78-07c57bc42b9b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059149 Jul 20 21:53:49.912587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 76/161] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:49.913227 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c8ba47ad-1413-4974-9a2f-792ea9b0725b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.372805 Jul 20 21:53:49.913997 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 86/162] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:49 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:49.918444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:49.919164 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:49.926503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.927379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:49.928442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:49.928894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.102791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:50.111400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:50.113038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:50.114515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-54963692-9174-4fb9-9574-1d9ef8c50d07 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.200003 Jul 20 21:53:50.115108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 77/163] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:49 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:50.117339 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1133595813", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "networks": [{"uuid": "b2060104-7bc0-45c3-94e1-057faf6e2e3a"}]}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:50.177784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] validate_networks() for [('b2060104-7bc0-45c3-94e1-057faf6e2e3a', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:53:50.443860 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:50.444471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:50.452420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.452838 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.453980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.454497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.721142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:53:50.721797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:53:50.722346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:53:50.722922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:53:50.723924 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:53:50.727409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:50.735423 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.735992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.736796 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.737229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.751511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:50.757277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Getting quotas for project 9a43767d64494137af74bbb2955ef55a. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:53:50.759381 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-419e9aaf-1401-4c86-9ecd-cfe6c987fbbd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.320560 Jul 20 21:53:50.759993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 78/164] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:50 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:50.761876 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Getting quotas for user 9c901aba30d141b39e7189eefc7c1ce1 and project 9a43767d64494137af74bbb2955ef55a. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:53:50.773405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:53:50.775712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:53:50.827412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-25146b7d-be8c-4b33-b8a8-f1147aecb9de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714524 Jul 20 21:53:50.828070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 87/165] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:53:50.838797 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7dcf930a-7577-45e1-b2a3-28ec6b8e9b10 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:50.839441 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7dcf930a-7577-45e1-b2a3-28ec6b8e9b10 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:50.870236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:50.870878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:50.878541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.879729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.881111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.881974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.902479 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7dcf930a-7577-45e1-b2a3-28ec6b8e9b10 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:50.915133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7dcf930a-7577-45e1-b2a3-28ec6b8e9b10 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1214 microversion: 2.1 time: 0.080296 Jul 20 21:53:50.916162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 79/166] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:50 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:50.933742 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:50.935313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:50.941973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.943084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:50.944369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:50.945003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.327093 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.341556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bec2baed-a008-4df2-a643-a315f8c555cc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.475408 Jul 20 21:53:51.342404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 88/167] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:50 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:51.350087 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:51.350856 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:51.357410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.358312 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.359383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.359965 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.389328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.408008 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2f4ac00e-a919-45ae-aedb-505d4864071c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1363 microversion: 2.1 time: 0.480345 Jul 20 21:53:51.408627 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 80/168] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:50 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:51.562902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.575996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.587483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.589099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5e0fa3bc-f3e6-40be-bb45-d589cdd7306e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1406 microversion: 2.20 time: 0.244314 Jul 20 21:53:51.600969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 89/169] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:51 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:51.777310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:51.778035 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:51.784662 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.785204 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.786265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.786706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.930520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-80eb9793-f246-498a-9060-e91007529a09 req-c0a0598c-9f28-4111-8d9f-424d9a49178b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a027718-c5db-48a7-bafd-4b4130e2380a", "name": "network-vif-plugged", "status": "completed", "tag": "ded61c9e-a55f-4fb8-8822-17313fc2edcf"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:51.940205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-80eb9793-f246-498a-9060-e91007529a09 req-c0a0598c-9f28-4111-8d9f-424d9a49178b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.940639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-80eb9793-f246-498a-9060-e91007529a09 req-c0a0598c-9f28-4111-8d9f-424d9a49178b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.947856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:51.956962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1fcb3a66-1bc1-4395-9b2c-6af99634f5ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.183494 Jul 20 21:53:51.958018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 81/170] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:51 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:51.966082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-80eb9793-f246-498a-9060-e91007529a09 req-c0a0598c-9f28-4111-8d9f-424d9a49178b service nova] Creating event network-vif-plugged:ded61c9e-a55f-4fb8-8822-17313fc2edcf for instance 5a027718-c5db-48a7-bafd-4b4130e2380a on hv-cinder-84969 Jul 20 21:53:51.971200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:51.971960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-80eb9793-f246-498a-9060-e91007529a09 req-c0a0598c-9f28-4111-8d9f-424d9a49178b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047796 Jul 20 21:53:51.972096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:51.972889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 90/171] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:51.979993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.980459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:51.981235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:51.981717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.050923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:52.059593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0c08db9f-54c3-44e0-871b-31ca95df7b75 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1218 microversion: 2.1 time: 0.099465 Jul 20 21:53:52.060375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 82/172] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:51 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:52.363252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:52.363252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:52.368949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.369680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.371073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.371868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.430075 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:52.431533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:52.442378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.443887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.445269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.445939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.452664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:52.750739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:52.755242 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:52.773343 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:52.783751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0daa1134-d0eb-426b-84bc-07a61a4e88a4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1548 microversion: 2.1 time: 0.362010 Jul 20 21:53:52.787688 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 83/173] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:52 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1548 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:52.790696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f6785852-9c89-477d-826a-e88bf8103467 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.434150 Jul 20 21:53:52.802646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 91/174] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:52 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:52.807768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:52.808272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:52.814485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.814939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.815755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:52.815888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.816197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.816379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:52.825856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.827007 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:52.828042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:52.828637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.062133 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9faf7ed7-7c1a-4c1e-910a-73a582a85b84 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.258645 Jul 20 21:53:53.063551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 92/175] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:53:52 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-interface => generated 285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:53:53.069491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:53.070429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:53.089724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.091686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.092714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.093158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.138701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:53.151025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:53.156892 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:53.158420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-215a6a73-71e0-4170-bc31-b5576244ea65 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1598 microversion: 2.20 time: 0.363696 Jul 20 21:53:53.159581 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 84/176] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:53:52 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1598 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:53:53.168840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:53.169891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:53.185830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.186941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.187949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.188602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.418541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:53.443598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-44cb8156-657d-4245-af72-ef517ad4f6ba tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1210 microversion: 2.1 time: 0.282333 Jul 20 21:53:53.444539 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 85/177] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:53 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1210 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:53.469171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:53.470074 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:53.484234 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.490151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.491336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.491993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.561375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:53.573488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8630c9c0-3351-4a97-ace8-1fb0fb9834d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.508223 Jul 20 21:53:53.579428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 93/178] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:53 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:53.672292 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6ffa4673-ded7-4337-b52a-9614a9a053c4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211587 Jul 20 21:53:53.681711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 86/179] 10.222.0.86 () {60 vars in 1315 bytes} [Wed Jul 20 21:53:53 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:53:53.815668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:53.816542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:53.829460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.830277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:53.831403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:53.831953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:54.252352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:54.261939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5ea0531a-f60b-49a7-9116-ba7c22f0fb5e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.451909 Jul 20 21:53:54.272244 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 94/180] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:53 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:54.462904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:54.463695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:54.480921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:54.483271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:54.484394 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:54.485955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:54.597299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:54.599157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:54.612078 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:54.614834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:54.617744 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:54.623787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:54.922047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:54.933554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-595e9cce-0f5a-4d0f-aff5-5ec71dfaf66e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.476225 Jul 20 21:53:54.936123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 87/181] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:54 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:55.027833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-b4e11d14-2573-40d8-8ed0-7d3afc16fb85 req-cdee2ada-b019-4496-bb27-60352106a9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd54893a-7604-4639-97b3-049128aac78b", "tag": "18e13523-1791-4e22-bd94-50f9617505c0"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:55.044541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-b4e11d14-2573-40d8-8ed0-7d3afc16fb85 req-cdee2ada-b019-4496-bb27-60352106a9c5 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.045307 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-b4e11d14-2573-40d8-8ed0-7d3afc16fb85 req-cdee2ada-b019-4496-bb27-60352106a9c5 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:55.087925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-b4e11d14-2573-40d8-8ed0-7d3afc16fb85 req-cdee2ada-b019-4496-bb27-60352106a9c5 service nova] Creating event network-changed:18e13523-1791-4e22-bd94-50f9617505c0 for instance cd54893a-7604-4639-97b3-049128aac78b on hv-cinder-84969 Jul 20 21:53:55.096468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-b4e11d14-2573-40d8-8ed0-7d3afc16fb85 req-cdee2ada-b019-4496-bb27-60352106a9c5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073584 Jul 20 21:53:55.101779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 88/182] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:55.121445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:55.130025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e00ca33e-b0d1-4148-9d6d-e1d26ee66ff8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.537533 Jul 20 21:53:55.136624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 95/183] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:54 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:55.279602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:55.280312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:55.287801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.288514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:55.289391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.289959 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:55.795751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:55.808146 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2d9a8351-16cf-4acf-9fde-68df442be59d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.532668 Jul 20 21:53:55.819142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 89/184] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:55 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:55.919054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-cb884df2-ced4-4bdf-9142-c2933883a7ba req-724e1f8d-4cae-49c5-937b-05b3bb6d2b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:53:55.928883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-cb884df2-ced4-4bdf-9142-c2933883a7ba req-724e1f8d-4cae-49c5-937b-05b3bb6d2b42 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.929901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-cb884df2-ced4-4bdf-9142-c2933883a7ba req-724e1f8d-4cae-49c5-937b-05b3bb6d2b42 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:55.945569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-cb884df2-ced4-4bdf-9142-c2933883a7ba req-724e1f8d-4cae-49c5-937b-05b3bb6d2b42 service nova] Creating event network-changed:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:53:55.951029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-cb884df2-ced4-4bdf-9142-c2933883a7ba req-724e1f8d-4cae-49c5-937b-05b3bb6d2b42 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037900 Jul 20 21:53:55.952013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 96/185] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:53:55.953115 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:55.953861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:55.961237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.961699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:55.965020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:55.965020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:56.059317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:56.068397 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1a716eb2-03d7-453b-b432-d25514dca00a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.119007 Jul 20 21:53:56.069077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 90/186] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:55 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:56.150651 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:56.151760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:56.158857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:56.159729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:56.161177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:56.161903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:56.390960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:56.400117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-986d8d8f-8ae3-47ba-842b-7f4aafd41144 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.256363 Jul 20 21:53:56.401765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 97/187] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:56 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:56.825953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:56.827200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:56.835777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:56.836232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:56.837015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:56.837448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:56.987244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:56.996392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-42f51d2c-8029-4fda-b657-9092cd630a14 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.174336 Jul 20 21:53:56.996988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 91/188] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:56 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:57.086492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:57.087127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:57.093576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:57.094023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:57.094993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:57.095456 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:57.164682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:57.172561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-06c2f133-9f43-46fe-a163-582dbc03f39c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.090994 Jul 20 21:53:57.173399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 98/189] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:57 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:57.417063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:57.417658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:57.424006 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:57.424535 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:57.425299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:57.425729 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:57.560018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:57.568331 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-44167d1d-4826-4ccb-93e4-f5fe9ddac2b9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.155147 Jul 20 21:53:57.568921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 92/190] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:57 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:58.013854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:58.014455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:58.020760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.021199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.021957 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.022388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.161923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:58.171132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ff4e4638-8ea3-42b9-bf20-8fe6687e775f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.161054 Jul 20 21:53:58.171623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 99/191] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:58 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:58.188913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:58.189530 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:58.196231 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.196711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.197485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.197936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.264218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:58.272134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9b0967c5-57c0-43a0-8b9e-cc8e59248f67 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.087069 Jul 20 21:53:58.272723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 93/192] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:58 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:58.585491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:58.586096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:58.593454 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.593909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.594671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:58.595129 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:58.729540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:58.737068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3b35ce44-2065-4afc-a933-eed544d53eb4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.155847 Jul 20 21:53:58.737642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 100/193] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:58 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:59.188768 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:59.189378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:59.195866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.196317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.197100 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.197535 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.289462 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:59.290273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:59.296788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.297316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.298148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.298640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.335014 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:59.342868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-87271d7d-e3af-4713-a23d-69a5ca0f621d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.157937 Jul 20 21:53:59.343662 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 94/194] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:59 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:53:59.368988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:59.376566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-34f90d15-5da6-4f52-b87c-04116cff2564 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.091635 Jul 20 21:53:59.377158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 101/195] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:59 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:53:59.754906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:53:59.755831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:53:59.762017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.762473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.763280 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:53:59.763722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:53:59.897943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:53:59.905634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a1153320-514e-43c2-a040-2c6f890fa3c6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.155058 Jul 20 21:53:59.906222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 95/196] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:53:59 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:00.360515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:00.361144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:00.368905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.369347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:00.370214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.370638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:00.393375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:00.394627 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:00.401649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.402104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:00.402882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.403353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:00.478926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:00.490373 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-748faaea-f05b-4ed6-b858-6af9b390e79e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1266 microversion: 2.1 time: 0.100632 Jul 20 21:54:00.491832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 96/197] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:00 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:00.716895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:00.728788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-25b077df-96be-4d61-a873-988cda3c510e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.371958 Jul 20 21:54:00.729404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 102/198] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:00 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:00.922741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:00.923324 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:00.925282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:00.931069 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.931532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:00.932296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:00.932721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.065658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:01.073604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-267ca44a-ede5-4ea0-8410-9162fbe4c61c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.154672 Jul 20 21:54:01.074185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 97/199] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:00 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:01.200481 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:01.200975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:01.202937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:01.203622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:01.210313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.210751 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.211542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.211968 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.237308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:54:01.335590 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-da51f9f5-01f5-42b5-a399-3ce1b4c98822 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 204 len: 0 microversion: 2.1 time: 0.138364 Jul 20 21:54:01.335888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 103/200] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:54:01 2022] DELETE /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:54:01.344406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:01.345024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:01.351387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.351840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.352612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.353046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.492651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:01.501017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-034f67b5-31f2-4396-93d0-f20e5806d79e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.160525 Jul 20 21:54:01.501603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 98/201] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:01 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:01.509533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:01.510626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:01.517593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.518057 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.518839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.519300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.583996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:01.591817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-48845c0c-6d16-4536-8fc1-047ab6ffdd1e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1274 microversion: 2.1 time: 0.087986 Jul 20 21:54:01.592403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 104/202] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:01 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:01.746002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:01.746614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:01.752897 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.753346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.754145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:01.755178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:01.896281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:01.904000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c3fc1942-f806-477c-badc-78ff47eb8a91 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.162058 Jul 20 21:54:01.904782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 99/203] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:01 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:02.089955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:02.090554 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:02.096662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.097103 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.098448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.098892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.234732 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:02.244135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8b54b8f0-eee3-4be2-b184-540ee4bef6c5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.157732 Jul 20 21:54:02.244716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 105/204] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:02 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:02.519536 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:02.520690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:02.527290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.527735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.528491 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.528923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.612441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:02.613054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:02.620284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.620723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.621491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.621917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.676313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:02.680085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:02.685996 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1175217f-d340-43c7-b838-fbb33c4c46c8 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.170263 Jul 20 21:54:02.687022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 100/205] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:02 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:02.704193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:02.712314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-540ab5eb-4b5c-461b-9d6e-f4385b7c61ae tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1274 microversion: 2.1 time: 0.105502 Jul 20 21:54:02.712918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 106/206] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:02 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:02.922003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:02.922621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:02.928765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.929217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:02.929987 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:02.930421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.065937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:03.074141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8a6ffeef-0020-4632-9ae4-02979c34e23c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.156299 Jul 20 21:54:03.074725 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 101/207] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:02 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:03.261009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:03.261640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:03.268197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.268644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.269410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.269843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.408904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:03.413146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:03.418527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-157de2e9-1d6f-45ce-a2df-c0d3821ea36d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.161418 Jul 20 21:54:03.419142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 107/208] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:03 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:03.704100 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:03.704719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:03.711876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.712330 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.713116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.713553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.729385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:03.729882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:03.738196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.738907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.740536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:03.740919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:03.819677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:03.827434 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b0f0ed45-46f0-4103-adf8-9b88b99043ad tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1274 microversion: 2.1 time: 0.102357 Jul 20 21:54:03.828202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 108/209] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:03 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:03.884824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:03.892982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7ec82d06-f653-4349-a2cc-9b3e77898d9f tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.192736 Jul 20 21:54:03.893783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 102/210] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:03 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:04.091203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:04.091978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:04.098159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.098614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.100445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.100891 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.234331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:04.241913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-dbabc27e-5e73-435d-845e-86220de3a348 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.154536 Jul 20 21:54:04.242506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 109/211] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:04 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:04.436354 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:04.436969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:04.443958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.444422 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.445207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.445656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.600813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:04.608521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5ab935c6-fb73-4550-9149-644004f4f30e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.176024 Jul 20 21:54:04.609752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 103/212] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:04 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:04.845831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:04.846366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:04.855308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.855784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.856559 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.856986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.910996 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:04.912547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:04.919422 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.919875 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.920655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:04.921088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:04.924590 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:04.933355 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6301b0b7-d1b1-4976-af67-a96beeca452d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1274 microversion: 2.1 time: 0.091400 Jul 20 21:54:04.934046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 110/213] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:04 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:05.162265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:05.171402 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-17a7f647-3360-4a7d-b7dd-7253ddca651c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.264187 Jul 20 21:54:05.172015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 104/214] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:04 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:05.259508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:05.260147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:05.266787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.267288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:05.268063 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.268690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:05.403762 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:05.412203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-37d92250-0ae9-4b62-abcc-7b87f6f692ea tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.156030 Jul 20 21:54:05.412548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 111/215] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:05 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:05.626813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:05.627461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:05.634287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.634739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:05.635549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.635988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:05.780005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:05.790709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d3503e4d-d723-4925-8063-97ba0ecbd179 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.165570 Jul 20 21:54:05.790709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 105/216] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:05 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:05.951811 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:05.952489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:05.960173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.960615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:05.961383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:05.961807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.032892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:06.040646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cc53f7b4-eb6e-41ff-aff4-95fa62c0fd60 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1284 microversion: 2.1 time: 0.093429 Jul 20 21:54:06.041202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 112/217] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:05 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:06.189781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:06.190426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:06.197776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.198239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.199029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.199496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.350152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:06.358841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1c4d9ea8-9a22-46e1-b9df-73c4dea38ae5 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.173733 Jul 20 21:54:06.359469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 106/218] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:06 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:06.429827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:06.430426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:06.436678 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.437121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.437883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.438306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.570964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:06.578633 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5074429a-1db0-4b9c-9a55-c4958ee32d92 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.153446 Jul 20 21:54:06.579241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 113/219] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:06 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:06.805986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:06.806593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:06.812632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.813078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.813839 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:06.814270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:06.952355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:06.961279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-667fb317-cb04-434a-a688-054491176b0f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.159540 Jul 20 21:54:06.962084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 107/220] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:06 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:07.059415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:07.060028 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:07.066322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.066768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.068251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.068689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.133195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:07.140695 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-53636c3c-be96-442c-8019-9523c45ed152 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1284 microversion: 2.1 time: 0.085093 Jul 20 21:54:07.141271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 114/221] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:07 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:07.376941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:07.377381 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:07.384033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.384359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.385119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.385556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.517662 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:07.526786 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-430046d0-6948-483b-aed4-5300fe92200b tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.153821 Jul 20 21:54:07.527422 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 108/222] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:07 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:07.596379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:07.596992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:07.603889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.604339 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.605106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.605546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.742350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:07.750166 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4429b288-b712-43f2-86c2-dca6672d5a2f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.157643 Jul 20 21:54:07.750734 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 115/223] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:07 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:07.980180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:07.981117 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:07.987987 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.988417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:07.989185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:07.990468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.127386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:08.135192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0f22a005-c247-4a08-99fb-b74a70be56e0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.160357 Jul 20 21:54:08.135779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 109/224] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:07 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:08.157603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:08.158211 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:08.165022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.165472 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.166283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.166715 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.232395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:08.240792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f77e2f21-c327-497c-8abd-4a51e9dcc5f5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1284 microversion: 2.1 time: 0.086978 Jul 20 21:54:08.241367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 116/225] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:08 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:08.543992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:08.544677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:08.551251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.551705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.552983 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.553417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.691591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:08.699357 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ce9e8db5-3c0f-4a3a-80da-8e06ed1ba1fc tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.159250 Jul 20 21:54:08.699947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 110/226] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:08 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:08.767085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:08.767628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:08.773843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.774295 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.775102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:08.775537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:08.908788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:08.917183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-decbda58-16d4-4afd-ab13-12fc11bcef46 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.154049 Jul 20 21:54:08.917779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 117/227] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:08 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:09.152582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:09.153190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:09.159216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.159673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.160734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.162018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.257619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:09.258326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:09.264630 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.265188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.266031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.266537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.296002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:09.304373 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ee9ba4e4-f5d3-4df6-be2e-bf97df261d48 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.155538 Jul 20 21:54:09.304998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 111/228] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:09 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:09.330758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:09.338915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ed9108c1-070a-442f-ae20-8e15adee6959 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1284 microversion: 2.1 time: 0.085124 Jul 20 21:54:09.339436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 118/229] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:09 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:09.716649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:09.717195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:09.723921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.724375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.725263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.725703 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.861528 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:09.870680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9a9f91c6-3cd0-42a1-8e00-4dd7ae34a866 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.157964 Jul 20 21:54:09.871291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 112/230] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:09 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:09.934694 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:09.935336 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:09.941691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.942143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:09.943978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:09.944556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.086030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:10.095991 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ee08d800-7ba1-4472-a600-74c4a1f79a34 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.164896 Jul 20 21:54:10.096822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 119/231] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:09 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:10.321509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:10.322012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:10.328173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.328616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.329372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.329801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.358962 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:10.360788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:10.379974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.381588 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.382683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.383246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.491937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:10.500630 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a1dc39f7-6f05-4103-979a-e99758e5abdf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1272 microversion: 2.1 time: 0.147163 Jul 20 21:54:10.501214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 120/232] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:10 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:10.619776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:10.627699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8a95bd8f-754b-4dde-9a0c-ce31e2d860d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.310340 Jul 20 21:54:10.628375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 113/233] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:10 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:10.890683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:10.891237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:10.898221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.898662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:10.899451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:10.899879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.038250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:11.046347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6970c300-3e1d-4b90-bd29-5de64054ba52 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.161546 Jul 20 21:54:11.047093 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 121/234] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:10 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:11.115116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:11.115787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:11.125044 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.125486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.126330 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.126876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.275428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:11.283105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-54791414-496b-4c9e-b25f-902b501e3e83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1367 microversion: 2.1 time: 0.172887 Jul 20 21:54:11.283727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 114/235] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:11 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:11.517658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:11.518261 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:11.525566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.526086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.527263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.528404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.591170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:11.599394 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bfcc2764-242e-48ef-ad2b-9a3c915b12c6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1272 microversion: 2.1 time: 0.084913 Jul 20 21:54:11.600101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 122/236] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:11 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:11.645325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:11.645982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:11.652400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.652937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.653691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:11.654532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:11.800151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:11.810915 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7c459514-1f2d-4675-8966-87b588ee7883 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.169375 Jul 20 21:54:11.811566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 115/237] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:11 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:12.064237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:12.064849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:12.072708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.073281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.074197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.074714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.232782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:12.244107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0c5fc28d-ade1-4f79-ac5b-4a716ede8f3c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.183955 Jul 20 21:54:12.245259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 123/238] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:12 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:12.300124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:12.300913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:12.309832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.310299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.311095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.311564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.459935 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:12.467948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c0735261-17f1-4e70-aca5-2ace74f49410 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1557 microversion: 2.1 time: 0.171581 Jul 20 21:54:12.468559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 116/239] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:12 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:12.485977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:12.486474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:12.493215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.493669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.494996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.495468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.512863 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:12.585777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1c885c61-df22-4a9e-8ffc-a33319cd3e99 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103667 Jul 20 21:54:12.586629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 124/240] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:54:12 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:12.616694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:12.617295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:12.624436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.624883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.625659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.626087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.649320 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:12.828851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:12.829453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:12.836908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.837351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:12.838132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:12.838748 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:13.076175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:13.099835 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8ed193aa-339d-46b2-8b0c-85229ceea33c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1272 microversion: 2.1 time: 0.487121 Jul 20 21:54:13.100927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 117/241] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:12 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1272 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:13.262960 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:13.263794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:13.269968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:13.270446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:13.271783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:13.272214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:13.589542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:13.605879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-07562863-4e5a-40c8-830f-57013653fe7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.780461 Jul 20 21:54:13.607012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 125/242] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:12 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:13.772158 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:13.784359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e311e419-dbcb-41e4-8ada-b35deec4e482 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.525535 Jul 20 21:54:13.786450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 118/243] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:13 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:14.117855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:14.118684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:14.125531 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.125983 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:14.126755 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.127222 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:14.248930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:14.259476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-257ea0a0-d06f-478c-bf3e-2a9f9d6c65d2 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1272 microversion: 2.1 time: 0.145993 Jul 20 21:54:14.268994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 126/244] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:14 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:14.626216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:14.627169 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:14.632344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=98 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:14.638981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.639467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:14.640247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.640768 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:14.807108 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:14.808567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:14.815188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.815641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:14.816417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:14.816848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:15.274280 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:15.282109 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3c21721f-ea91-4bb0-80d6-7dc0c363a4b8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.661674 Jul 20 21:54:15.293264 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 119/245] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:14 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:15.298768 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:15.299756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:15.319290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:15.319658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:15.320455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:15.320889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:15.332641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:15.344525 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fbcbdb9f-f59e-4640-96db-55284cb35d20 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.542509 Jul 20 21:54:15.354545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 127/246] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:14 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:15.464920 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-d7ef81d7-ee72-4b1e-9d0b-da78d15a6e21 req-88202904-47ab-477e-aae8-3c8399dcbae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a027718-c5db-48a7-bafd-4b4130e2380a", "tag": "ded61c9e-a55f-4fb8-8822-17313fc2edcf"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:15.471010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:15.477926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d7ef81d7-ee72-4b1e-9d0b-da78d15a6e21 req-88202904-47ab-477e-aae8-3c8399dcbae0 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:15.478695 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d7ef81d7-ee72-4b1e-9d0b-da78d15a6e21 req-88202904-47ab-477e-aae8-3c8399dcbae0 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:15.494898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-d7ef81d7-ee72-4b1e-9d0b-da78d15a6e21 req-88202904-47ab-477e-aae8-3c8399dcbae0 service nova] Creating event network-changed:ded61c9e-a55f-4fb8-8822-17313fc2edcf for instance 5a027718-c5db-48a7-bafd-4b4130e2380a on hv-cinder-84969 Jul 20 21:54:15.501225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-d7ef81d7-ee72-4b1e-9d0b-da78d15a6e21 req-88202904-47ab-477e-aae8-3c8399dcbae0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039927 Jul 20 21:54:15.504029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 128/247] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:54:15.518212 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:15.527803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-06aa7cf5-e27b-4fd3-95f6-0d9018f3a548 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.232812 Jul 20 21:54:15.528676 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 120/248] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:15 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:15.754154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-b532caae-35bf-4c48-8440-62e84f9660ff req-15ca8f8f-6aac-44e0-933e-3464c3157a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bf4672-424a-4c1d-adf8-379c0406c751", "name": "network-vif-unplugged", "status": "completed", "tag": "d3f6ee20-eed2-4116-a54e-d4abfce56f7f"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:15.764188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-b532caae-35bf-4c48-8440-62e84f9660ff req-15ca8f8f-6aac-44e0-933e-3464c3157a97 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:15.764855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-b532caae-35bf-4c48-8440-62e84f9660ff req-15ca8f8f-6aac-44e0-933e-3464c3157a97 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:15.782504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-b532caae-35bf-4c48-8440-62e84f9660ff req-15ca8f8f-6aac-44e0-933e-3464c3157a97 service nova] Creating event network-vif-unplugged:d3f6ee20-eed2-4116-a54e-d4abfce56f7f for instance f9bf4672-424a-4c1d-adf8-379c0406c751 on hv-cinder-84969 Jul 20 21:54:15.788351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-b532caae-35bf-4c48-8440-62e84f9660ff req-15ca8f8f-6aac-44e0-933e-3464c3157a97 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038633 Jul 20 21:54:15.789442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 129/249] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:16.300263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:16.300876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:16.308243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.308688 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.309464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.309960 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.362553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:16.363951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:16.373012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.373719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.374707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.375329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.576312 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:16.586131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-99c01cda-4e18-4b77-860d-d02aa0857ba0 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.227815 Jul 20 21:54:16.586718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 130/250] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:16 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:16.593398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:16.594276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:16.601792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.602240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.603206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:16.603634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:16.629126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:16.637302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-15655764-ee7a-4c57-8453-a9eaf9e58adb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.340970 Jul 20 21:54:16.638150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 121/251] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:16 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:16.757689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:16.765788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1412f7b4-7c26-4526-82a6-4bd644b329cf tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.177505 Jul 20 21:54:16.766368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 131/252] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:16 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:17.602738 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:17.603376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:17.610093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.610538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.611332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.611760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.654832 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:17.655469 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:17.662185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.662624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.663406 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.663836 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.818018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:17.828112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a23e4751-58fe-4b09-b29f-1203de6b624e tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.229613 Jul 20 21:54:17.828822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 122/253] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:17 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:17.834164 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:17.835234 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:17.842003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.842455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.843329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:17.843763 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:17.848033 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:17.858542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2916b851-3909-43bf-9655-16a9172dea98 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.207411 Jul 20 21:54:17.859150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 132/254] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:17 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:17.993200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:18.003758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4b976309-0cc1-44f0-a115-8b2f23fbbbea tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.172174 Jul 20 21:54:18.003758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 123/255] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:17 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:18.845088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:18.845714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:18.852529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:18.853092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:18.854085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:18.854631 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:18.880733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:18.881328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:18.888228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:18.888683 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:18.889468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:18.889993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:19.048639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:19.057992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8a7c0afd-5fdf-45c2-b1b2-836ccf2e763c tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 0.216626 Jul 20 21:54:19.058579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 133/256] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:18 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:19.063255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:19.063916 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:19.071527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:19.071973 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:19.072737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:19.073386 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:19.083951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:19.092297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-29055c5f-78de-415b-97e6-dc3f28214f89 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.216087 Jul 20 21:54:19.092886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 124/257] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:18 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:19.210502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:19.218259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4efcbc5b-edc8-4dc3-82b8-9d5bb3581605 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.158622 Jul 20 21:54:19.218844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 134/258] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:19 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:20.074862 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:20.075542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:20.082650 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.084052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:20.085207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.085913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:20.109725 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:20.110332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:20.121761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.122211 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:20.123102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.123548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:20.800126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:20.808805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-691316db-df69-4bd9-bad1-497abab014e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.702779 Jul 20 21:54:20.809407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 135/259] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:20 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:20.820492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:20.821121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:20.827922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.828378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:20.829154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:20.829589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:21.110475 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:21.121133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b31367ce-ead5-44c5-a368-07b1ee6a7bbb tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1554 microversion: 2.1 time: 1.049913 Jul 20 21:54:21.122051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 125/260] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:20 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1554 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:21.442834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:21.456102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1de6b834-c3b8-4dbc-9205-dc255e9a359f tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.645646 Jul 20 21:54:21.462429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 136/261] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:20 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:21.784994 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-7e70dc2c-929e-4cb1-bdf4-782a0e07ea69 req-85f4e83e-a323-4b03-b7cf-786d1d36f804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bf4672-424a-4c1d-adf8-379c0406c751", "name": "network-vif-deleted", "tag": "d3f6ee20-eed2-4116-a54e-d4abfce56f7f"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:21.795532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-7e70dc2c-929e-4cb1-bdf4-782a0e07ea69 req-85f4e83e-a323-4b03-b7cf-786d1d36f804 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:21.796310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-7e70dc2c-929e-4cb1-bdf4-782a0e07ea69 req-85f4e83e-a323-4b03-b7cf-786d1d36f804 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:21.816844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-7e70dc2c-929e-4cb1-bdf4-782a0e07ea69 req-85f4e83e-a323-4b03-b7cf-786d1d36f804 service nova] Creating event network-vif-deleted:d3f6ee20-eed2-4116-a54e-d4abfce56f7f for instance f9bf4672-424a-4c1d-adf8-379c0406c751 on hv-cinder-84969 Jul 20 21:54:21.825851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:21.827131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:21.839456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-7e70dc2c-929e-4cb1-bdf4-782a0e07ea69 req-85f4e83e-a323-4b03-b7cf-786d1d36f804 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058717 Jul 20 21:54:21.841021 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 126/262] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:21.841334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:21.842078 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:21.856507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:21.859269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:22.145168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:22.146832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:22.150949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:22.157778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:22.158129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:22.159108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:22.159759 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:22.164350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0976382b-42a8-41df-a90f-e00e9b6ad90c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1521 microversion: 2.1 time: 0.342426 Jul 20 21:54:22.179237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 137/263] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:21 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:22.279801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:22.287754 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bd6eafcb-d25f-49e0-84ff-885c146f8b00 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1346 microversion: 2.1 time: 0.150471 Jul 20 21:54:22.288972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 127/264] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:22 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:22.475022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:22.476075 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:22.482541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:22.482996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:22.483867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:22.484311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:22.635421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:22.643364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8200821d-f32c-4882-98e8-445376a4d923 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.173307 Jul 20 21:54:22.644161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 138/265] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:22 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:23.184078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:23.186598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:23.195203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.196052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.197526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.198415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.313532 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:23.316023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:23.330483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.331810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.335600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.336084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.471308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e755a5fe9f4c5c95376beae691381f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932a50a36025440583c478450e42f9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:23.488177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-96a8687b-b339-4bd0-a2b7-b73ef72c7471 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 200 len: 1346 microversion: 2.1 time: 0.183219 Jul 20 21:54:23.495110 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 139/266] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:23 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:23.544812 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:23.557386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c42b6d51-9089-4d3d-b7e5-22241db1b926 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1501 microversion: 2.1 time: 0.377363 Jul 20 21:54:23.560198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 128/267] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:23 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1501 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:23.576702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:23.577316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:23.585668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.586117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.586887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.587343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.660776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:23.661359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:23.668617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.669136 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.670045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.670486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.780881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:23.788989 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-55ef6696-d19e-43e5-a12b-cbe26bcd5cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1514 microversion: 2.1 time: 0.216632 Jul 20 21:54:23.789584 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 140/268] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:23 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:23.866990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-1c1981d9-9de3-489c-a255-2686119ff5c7 req-87e97e07-6c72-4899-ab70-2be1d7e92e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b", "tag": "cffdde52-d3d7-4a3d-94cf-24f1d50222d7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:23.878909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1c1981d9-9de3-489c-a255-2686119ff5c7 req-87e97e07-6c72-4899-ab70-2be1d7e92e64 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:23.880265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1c1981d9-9de3-489c-a255-2686119ff5c7 req-87e97e07-6c72-4899-ab70-2be1d7e92e64 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:23.882523 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:23.891480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6cc6f56a-ed99-4b35-b4c1-e1e61fb31367 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.234729 Jul 20 21:54:23.892346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 129/269] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:23 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:23.903434 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-1c1981d9-9de3-489c-a255-2686119ff5c7 req-87e97e07-6c72-4899-ab70-2be1d7e92e64 service nova] Creating event network-changed:cffdde52-d3d7-4a3d-94cf-24f1d50222d7 for instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b on hv-cinder-84969 Jul 20 21:54:23.909568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-1c1981d9-9de3-489c-a255-2686119ff5c7 req-87e97e07-6c72-4899-ab70-2be1d7e92e64 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050865 Jul 20 21:54:23.910673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 141/270] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:24.508296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:24.508917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:24.515693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.516212 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:24.516990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.517422 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:24.532347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] HTTP exception thrown: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Request method failure captured: Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 HTTP/1.1 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk32Xgx7M2SG3LZkFOzkGaH_inA-lEW9vEFmDTUq-SgYUqf_7p2xOrXhSZaOIoVCjGOtxeXRzT-Sh9cBgC4k-PpQN53D-3gg9WUd7a-imwyYZbHV5y03rXV06_RmjsKu1AFzSSKG2E485qde0U2YCZienJUHhPn1hRxQ-JnFjOLjFw Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:54:24.537170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/932a50a36025440583c478450e42f9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_932a50a36025440583c478450e42f9e8", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}] Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 74e755a5fe9f4c5c95376beae691381f Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.538653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'f9bf4672-424a-4c1d-adf8-379c0406c751'} Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:54:24.539529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.540931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.542272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Returning 404 to user: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:54:24.542272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-48578179-0366-4d98-b60e-c0535bc8a19d tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 404 len: 111 microversion: 2.1 time: 0.035476 Jul 20 21:54:24.542272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 130/271] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:24 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:54:24.668263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:24.670466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:24.681039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.681717 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:24.684515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.684970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:24.708393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] HTTP exception thrown: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Request method failure captured: Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751/os-volume_attachments HTTP/1.1 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk32Xgx7M2SG3LZkFOzkGaH_inA-lEW9vEFmDTUq-SgYUqf_7p2xOrXhSZaOIoVCjGOtxeXRzT-Sh9cBgC4k-PpQN53D-3gg9WUd7a-imwyYZbHV5y03rXV06_RmjsKu1AFzSSKG2E485qde0U2YCZienJUHhPn1hRxQ-JnFjOLjFw Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:54:24.716782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/932a50a36025440583c478450e42f9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_932a50a36025440583c478450e42f9e8", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}] Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 74e755a5fe9f4c5c95376beae691381f Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.720463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'server_id': 'f9bf4672-424a-4c1d-adf8-379c0406c751'} Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:54:24.726808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:24.729047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:24.732370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Returning 404 to user: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:54:24.732370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f6bf6a82-1f82-4b64-8dad-f5bd9cf38612 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056745 Jul 20 21:54:24.732370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 142/272] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:54:24 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:54:24.910233 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:24.911357 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:24.918324 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.918783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:24.919594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:24.920031 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.094019 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:25.102890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-541e3f18-35ba-445a-996b-2cc2f156de94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.197373 Jul 20 21:54:25.103524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 131/273] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:24 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:25.341934 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:25.343118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:25.351224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.351927 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.352926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.353366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.381091 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'flavor' on Instance uuid 18ae5df2-b95e-4408-94a0-c75f87543061 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:54:25.432414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:25.499731 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8cf83cb0-33c2-4541-868d-e9ce8baf4687 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/action" status: 200 len: 32 microversion: 2.1 time: 0.164454 Jul 20 21:54:25.500391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 143/274] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:54:25 2022] POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 21:54:25.510863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:25.511623 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:25.518362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.518775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.519568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.520005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.689784 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:25.700356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c5352c88-c0d0-4a81-8753-c323a7ff07d1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.193513 Jul 20 21:54:25.701755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 132/275] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:25 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:25.955599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:25.956140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:25.965096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.965551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.966371 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:25.966807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:25.982930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] HTTP exception thrown: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Request method failure captured: Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: DELETE /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 HTTP/1.1 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk32Xgx7M2SG3LZkFOzkGaH_inA-lEW9vEFmDTUq-SgYUqf_7p2xOrXhSZaOIoVCjGOtxeXRzT-Sh9cBgC4k-PpQN53D-3gg9WUd7a-imwyYZbHV5y03rXV06_RmjsKu1AFzSSKG2E485qde0U2YCZienJUHhPn1hRxQ-JnFjOLjFw Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:54:25.985249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/932a50a36025440583c478450e42f9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_932a50a36025440583c478450e42f9e8", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}] Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 74e755a5fe9f4c5c95376beae691381f Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:25.986704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'f9bf4672-424a-4c1d-adf8-379c0406c751'} Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:54:25.987828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:25.989335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:54:25.990895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Returning 404 to user: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:54:25.990895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ca8dd302-8069-4466-855f-f391580b92be tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 404 len: 111 microversion: 2.1 time: 0.035399 Jul 20 21:54:25.990895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 144/276] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:54:25 2022] DELETE /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:54:25.996471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:26.000542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] [instance: f9bf4672-424a-4c1d-adf8-379c0406c751] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:26.009131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.009583 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:26.010637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.010796 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:26.033455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] HTTP exception thrown: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Request method failure captured: Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 HTTP/1.1 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk32Xgx7M2SG3LZkFOzkGaH_inA-lEW9vEFmDTUq-SgYUqf_7p2xOrXhSZaOIoVCjGOtxeXRzT-Sh9cBgC4k-PpQN53D-3gg9WUd7a-imwyYZbHV5y03rXV06_RmjsKu1AFzSSKG2E485qde0U2YCZienJUHhPn1hRxQ-JnFjOLjFw Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:54:26.036609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/932a50a36025440583c478450e42f9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_932a50a36025440583c478450e42f9e8", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/932a50a36025440583c478450e42f9e8"}]}] Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 932a50a36025440583c478450e42f9e8 Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016697434 Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 74e755a5fe9f4c5c95376beae691381f Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-DeleteServersTestJSON-2016697434-project Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:26.038088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'f9bf4672-424a-4c1d-adf8-379c0406c751'} Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:54:26.038962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. Jul 20 21:54:26.040413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:26.041790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] Returning 404 to user: Instance f9bf4672-424a-4c1d-adf8-379c0406c751 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:54:26.041790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6336eaa9-8e44-455d-9a03-0df22ec2bd75 tempest-DeleteServersTestJSON-2016697434 tempest-DeleteServersTestJSON-2016697434-project] 10.222.0.86 "GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751" status: 404 len: 111 microversion: 2.1 time: 0.045901 Jul 20 21:54:26.041790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 133/277] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:25 2022] GET /compute/v2.1/servers/f9bf4672-424a-4c1d-adf8-379c0406c751 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:54:26.124000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:26.124970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:26.154768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.155599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:26.159012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.159690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:26.691776 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:26.701396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a35d5c7d-f8ed-4df4-a839-8664a4209b45 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.584701 Jul 20 21:54:26.702640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 145/278] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:26 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:26.720223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:26.720968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:26.729795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.730450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:26.731549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:26.732094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:27.485389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:27.495413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7b2880a6-dcb5-419d-888b-eb7b988ecfda tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.779472 Jul 20 21:54:27.496097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 134/279] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:26 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:27.718273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:27.719641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:27.731776 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:27.732236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:27.733014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:27.733451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:28.230342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:28.239984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0405948d-5c5c-49df-81a1-524215cb6f48 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.525229 Jul 20 21:54:28.249513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 146/280] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:27 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:28.514120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:28.515137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:28.522575 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:28.523490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:28.524473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:28.525238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:28.755228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:28.764250 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6fc26e83-11ea-44be-a342-7698acc72ac1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.254326 Jul 20 21:54:28.765188 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 135/281] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:28 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:28.863168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-a01f3b75-115a-4ff7-a3fc-ddf271bf0910 req-ba1021fd-db7c-46d9-81d6-aaba6f40e23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b", "name": "network-vif-plugged", "status": "completed", "tag": "cffdde52-d3d7-4a3d-94cf-24f1d50222d7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:28.886745 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a01f3b75-115a-4ff7-a3fc-ddf271bf0910 req-ba1021fd-db7c-46d9-81d6-aaba6f40e23e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:28.887247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a01f3b75-115a-4ff7-a3fc-ddf271bf0910 req-ba1021fd-db7c-46d9-81d6-aaba6f40e23e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:28.902980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-a01f3b75-115a-4ff7-a3fc-ddf271bf0910 req-ba1021fd-db7c-46d9-81d6-aaba6f40e23e service nova] Creating event network-vif-plugged:cffdde52-d3d7-4a3d-94cf-24f1d50222d7 for instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b on hv-cinder-84969 Jul 20 21:54:28.909080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-a01f3b75-115a-4ff7-a3fc-ddf271bf0910 req-ba1021fd-db7c-46d9-81d6-aaba6f40e23e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049453 Jul 20 21:54:28.909965 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 147/282] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:29.260124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:29.261566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:29.270268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:29.271885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:29.271885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:29.273676 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:29.277983 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:29.713011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:29.727397 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-24936263-b611-4411-b2f4-dd88dfc67e88 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.473753 Jul 20 21:54:29.728789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 136/283] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:29 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:29.782107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:29.782812 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:29.789978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:29.790715 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:29.791697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:29.792288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:30.094488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:30.109425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9b7b65f9-8c78-4128-b977-7243b3f8586c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.331356 Jul 20 21:54:30.115576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 148/284] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:29 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:30.746583 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:30.748709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:30.768318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:30.768775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:30.769565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:30.770509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:30.950741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:30.960772 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0f0eadd6-94e3-489f-836d-116aa212c9ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.219179 Jul 20 21:54:30.961462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 137/285] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:30 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:31.133165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:31.133786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:31.144301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:31.145061 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:31.146674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:31.147137 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:31.372977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:31.383427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4bacab97-384d-4e34-abca-f55828b632d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.257409 Jul 20 21:54:31.384309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 149/286] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:31 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:31.981773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:31.982967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:31.991829 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:31.992727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:31.995592 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:31.996244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:32.210171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:32.220087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-71365e17-eb18-4087-b610-30daaf47026b tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1314 microversion: 2.1 time: 0.245473 Jul 20 21:54:32.220902 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 138/287] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:31 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:32.401893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:32.403961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:32.412440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:32.413403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:32.414987 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:32.415653 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:32.754500 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:32.768424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c90ecb76-ae17-4945-b343-52e301eae31f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.370563 Jul 20 21:54:32.779952 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 150/288] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:32 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:33.237639 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:33.238244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:33.245203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:33.245647 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:33.246446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:33.246871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:33.404177 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:33.412078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e8c67c77-c7d3-4294-9ad7-b6fbcdd606df tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1495 microversion: 2.1 time: 0.178172 Jul 20 21:54:33.412820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 139/289] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:33 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1495 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:33.790115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:33.792550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:33.801156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:33.802597 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:33.803532 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:33.803910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:34.000412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:34.008641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e7fe1c45-2b46-4eed-9d87-4fd065a35443 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.225116 Jul 20 21:54:34.009564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 151/290] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:33 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:34.215578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:34.216086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:34.222529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:34.222976 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:34.224896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:34.225339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:34.253553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:54:34.356002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-441f2c9e-23a1-43c3-b21e-cd7474380b1a tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 204 len: 0 microversion: 2.1 time: 0.144263 Jul 20 21:54:34.360099 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 140/291] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:54:34 2022] DELETE /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:54:34.367199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:34.368178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:34.374957 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:34.375667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:34.376531 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:34.377066 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:34.530186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:34.543384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-186a0cd4-dcb4-45f4-a980-4009eee7f3e9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1501 microversion: 2.1 time: 0.181187 Jul 20 21:54:34.544074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 152/292] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:34 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:35.027411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:35.028057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:35.034279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:35.034728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:35.035529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:35.036000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:35.173652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:35.181651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8693de44-73b1-4e58-bde6-d47d1b4377d9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.158529 Jul 20 21:54:35.182239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 141/293] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:35 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:35.561278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:35.561972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:35.569053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:35.570136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:35.571103 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:35.571559 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:35.765318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:35.775974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7e988525-900e-40a4-8f13-68e92ecffa26 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1501 microversion: 2.1 time: 0.218367 Jul 20 21:54:35.777337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 153/294] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:35 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:36.200782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:36.201465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:36.209868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:36.210604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:36.211568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:36.213264 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:36.405480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:36.414025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1cc1338c-5e92-4d8a-b8ee-1483949495eb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.218320 Jul 20 21:54:36.414616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 142/295] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:36 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:36.793954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:36.794640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:36.801040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:36.802545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:36.803209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:36.803664 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:36.953901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:36.962546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c51ffbfe-5ce3-4823-b5f4-f9747af2f1c9 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1501 microversion: 2.1 time: 0.172542 Jul 20 21:54:36.963161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 154/296] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:36 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:37.431991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:37.433204 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:37.439887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:37.440345 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:37.441123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:37.441567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:37.631712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:37.640101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-10862805-6571-4d12-89e4-203ad16562d6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.212076 Jul 20 21:54:37.641213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 143/297] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:37 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:37.981526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:37.982568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:37.988541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:37.989910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:37.990694 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:37.991346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:38.062700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-e07fd2de-d842-4861-9201-56ea42958f76 req-eaba7be9-8a5f-481d-b564-f6cc600b0806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b", "name": "network-vif-deleted", "tag": "cffdde52-d3d7-4a3d-94cf-24f1d50222d7"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:38.083514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e07fd2de-d842-4861-9201-56ea42958f76 req-eaba7be9-8a5f-481d-b564-f6cc600b0806 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:38.084130 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e07fd2de-d842-4861-9201-56ea42958f76 req-eaba7be9-8a5f-481d-b564-f6cc600b0806 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:38.089291 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:38.099886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-e07fd2de-d842-4861-9201-56ea42958f76 req-eaba7be9-8a5f-481d-b564-f6cc600b0806 service nova] Creating event network-vif-deleted:cffdde52-d3d7-4a3d-94cf-24f1d50222d7 for instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b on hv-cinder-84969 Jul 20 21:54:38.104059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1a95a6ca-ce48-4535-91a1-0da8bfa988e5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1459 microversion: 2.1 time: 0.126297 Jul 20 21:54:38.104648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 155/298] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:37 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1459 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:38.105238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-e07fd2de-d842-4861-9201-56ea42958f76 req-eaba7be9-8a5f-481d-b564-f6cc600b0806 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049870 Jul 20 21:54:38.105953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 144/299] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:38.657972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:38.658490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:38.664611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:38.665066 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:38.665809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:38.666232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:38.803607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:38.811316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f2a34980-b70c-4d8c-9839-123bdd6b06e2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.157389 Jul 20 21:54:38.811895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 156/300] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:38 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:39.122735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:39.123465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:39.132399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:39.132859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:39.133721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:39.134244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:39.200415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:39.208335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-719c0e4f-5978-413c-8994-ed90fc0e27a0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1459 microversion: 2.1 time: 0.090483 Jul 20 21:54:39.208990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 145/301] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:39 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1459 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:39.828553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:39.829136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:39.835924 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:39.836369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:39.837118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:39.837544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:39.970785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:39.979309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d4998e65-5227-4e68-b531-b6f4c7bda1bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.154464 Jul 20 21:54:39.979881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 157/302] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:39 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:40.225778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:40.226389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:40.233120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:40.233575 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:40.234360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:40.234791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:40.302469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:40.310040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8d081d0c-9a19-4516-bd5a-b67b048097f1 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1459 microversion: 2.1 time: 0.088316 Jul 20 21:54:40.310617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 146/303] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:40 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1459 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:40.996425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:40.997028 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:41.003323 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:41.003764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:41.005563 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:41.006023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:41.155305 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:41.162833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6ffa1224-ce00-4b16-bce7-bdd0e8c84989 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.170568 Jul 20 21:54:41.163431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 158/304] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:40 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:41.327618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:41.328163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:41.334794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:41.335278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:41.336039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:41.336467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:41.403791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:41.411452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9f5aab4e-d1bf-47f6-b6e5-98a240dc23bc tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1299 microversion: 2.1 time: 0.088025 Jul 20 21:54:41.412028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 147/305] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:41 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:42.179830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:42.180448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:42.186538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:42.186984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:42.187849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:42.188298 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:42.327780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:42.338980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b50f2401-4947-4471-9eb5-31ea084633c8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.162935 Jul 20 21:54:42.339861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 159/306] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:42 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:42.428204 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:42.428844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:42.435404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:42.435849 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:42.436616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:42.437049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:42.468956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:42.469411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:42.469856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lazy-loading 'fault' on Instance uuid 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:54:42.515762 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:42.524365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7843a7c2-71b1-47d8-9537-165739856e94 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 200 len: 1304 microversion: 2.1 time: 0.100163 Jul 20 21:54:42.525248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 148/307] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:42 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:43.358367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:43.358922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:43.366256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:43.366708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:43.369008 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:43.369008 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:43.387919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:43.516392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:43.525198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3c4d235f-3bdb-42e6-9518-75d73a843f15 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.170831 Jul 20 21:54:43.525785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 160/308] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:43 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:43.544998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:43.545602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:43.552365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:43.552804 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:43.553560 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:43.553988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:43.568350 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] HTTP exception thrown: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Request method failure captured: Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b HTTP/1.1 Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hlr8etTi1T623FkMeUp6Lqw1IWNi1O-jaS54sKqexJK2UwDiePWMSI1NiK76pNcY3pwVDdUcnxnCdzU9k4FMm9f8pjaqNmb49xx8XNEKVzjC6gSsfQE7xd-TB7U7mQzOV2gRyskBUJTVJDa_kInph7XJq6HCsd1LY_aIur7PV1Nn3I Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 9a43767d64494137af74bbb2955ef55a Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-VolumesActionsTest-134536421 Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:54:43.570003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9a43767d64494137af74bbb2955ef55a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9a43767d64494137af74bbb2955ef55a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a43767d64494137af74bbb2955ef55a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a43767d64494137af74bbb2955ef55a"}]}] Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-VolumesActionsTest-134536421 Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 9a43767d64494137af74bbb2955ef55a Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-VolumesActionsTest-134536421 Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-VolumesActionsTest-134536421-project Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 9c901aba30d141b39e7189eefc7c1ce1 Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-VolumesActionsTest-134536421-project Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. Jul 20 21:54:43.571426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b'} Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:54:43.572137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. Jul 20 21:54:43.573566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:54:43.574758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Returning 404 to user: Instance 7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:54:43.574758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-076d2688-306d-4b27-b5d2-491056f0b300 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jul 20 21:54:43.574758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 149/309] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:43 2022] GET /compute/v2.1/servers/7b7e7fdf-bc13-48f2-960d-6f73edcf4d1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:54:43.679040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-914197657", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "networks": [{"uuid": "b2060104-7bc0-45c3-94e1-057faf6e2e3a"}]}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:43.731436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] validate_networks() for [('b2060104-7bc0-45c3-94e1-057faf6e2e3a', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:54:44.132135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:54:44.132778 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:54:44.133322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:54:44.133670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:54:44.134090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:54:44.144351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:44.144661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:44.146071 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:44.146979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:44.173182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Getting quotas for project 9a43767d64494137af74bbb2955ef55a. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:54:44.179887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Getting quotas for user 9c901aba30d141b39e7189eefc7c1ce1 and project 9a43767d64494137af74bbb2955ef55a. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:54:44.196238 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:54:44.198542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:54:44.253398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ce7791a6-5004-41c1-a101-b9213777bf4e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578051 Jul 20 21:54:44.255335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 161/310] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:54:44.264957 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-effdf559-1978-412d-90ab-1c60bff03f0e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:44.265584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-effdf559-1978-412d-90ab-1c60bff03f0e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:44.332112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-effdf559-1978-412d-90ab-1c60bff03f0e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:44.340256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-effdf559-1978-412d-90ab-1c60bff03f0e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1213 microversion: 2.1 time: 0.079362 Jul 20 21:54:44.340863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 150/311] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:44 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:44.542354 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:44.543090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:44.549522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:44.552788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:44.552788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:44.552788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:44.698677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:44.707254 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fb1d09ce-450c-475b-9380-b231bf2279fb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.168720 Jul 20 21:54:44.707932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 162/312] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:44 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:45.358542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:45.359650 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:45.362434 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:45.370003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:45.370497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:45.371464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:45.371909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:45.439524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:45.450271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-76aff25d-8b57-4c88-af8b-ffd6552fdcda tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1265 microversion: 2.1 time: 0.095982 Jul 20 21:54:45.450942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 151/313] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:45 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:45.729351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:45.730561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:45.734383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:45.739837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:45.740277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:45.741270 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:45.741883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:45.991475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:45.999740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c2b45786-bfbc-4418-ab8b-57ca40e1f2ab tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.277227 Jul 20 21:54:46.001109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 163/314] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:45 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:46.468395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:46.469513 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:46.476633 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:46.477082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:46.478120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:46.478525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:46.683021 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:46.694296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b1bb8961-e51f-4880-b4cc-b79f23f18770 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.229717 Jul 20 21:54:46.694889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 152/315] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:46 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:47.022626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:47.022626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:47.035311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:47.036891 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:47.038050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:47.038844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:47.282401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:47.290971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-93380091-3635-4b46-b999-4e77a34a9de2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.276329 Jul 20 21:54:47.291550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 164/316] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:47 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:47.359858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-73974970-cd2a-4c1f-af39-2132d5ad7672 req-e8671388-2c00-4ec9-a9d9-c0182006795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425b18bb-683a-4a73-bab8-494d8532a412", "tag": "0231e535-fe69-40cd-96c3-9cd801d67a2e"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:47.368062 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-73974970-cd2a-4c1f-af39-2132d5ad7672 req-e8671388-2c00-4ec9-a9d9-c0182006795f service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:47.368514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-73974970-cd2a-4c1f-af39-2132d5ad7672 req-e8671388-2c00-4ec9-a9d9-c0182006795f service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:47.373338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:47.389318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-73974970-cd2a-4c1f-af39-2132d5ad7672 req-e8671388-2c00-4ec9-a9d9-c0182006795f service nova] Creating event network-changed:0231e535-fe69-40cd-96c3-9cd801d67a2e for instance 425b18bb-683a-4a73-bab8-494d8532a412 on hv-cinder-84969 Jul 20 21:54:47.394997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-73974970-cd2a-4c1f-af39-2132d5ad7672 req-e8671388-2c00-4ec9-a9d9-c0182006795f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041213 Jul 20 21:54:47.395715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 153/317] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:47.713585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:47.714835 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:47.722578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:47.724004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:47.724572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:47.725028 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:47.943961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:47.956083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be587424-a8bb-451f-a856-792ab7b68be6 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.246598 Jul 20 21:54:47.957265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 165/318] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:47 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:48.308824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:48.309541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:48.317407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:48.318168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:48.318998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:48.319436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:48.470036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:48.478185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c8844dc9-1c7b-496b-a0ff-465649937df9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.174454 Jul 20 21:54:48.479000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 154/319] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:48 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:48.974792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:48.975545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:48.982064 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:48.982523 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:48.983324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:48.983871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:49.124958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:49.132670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8a8e467a-ba09-4475-bbd3-204729107430 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.161976 Jul 20 21:54:49.133239 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 166/320] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:48 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:49.497308 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:49.497959 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:49.506113 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:49.506602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:49.507464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:49.507901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:49.650048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:49.656520 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1f778609-f757-45f6-987e-86d2e3043df4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.164349 Jul 20 21:54:49.657382 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 155/321] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:49 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:50.149833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:50.150606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:50.160233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:50.160818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:50.161639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:50.162074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:50.367394 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:50.376070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-beb7a616-91af-40aa-95ab-9020cee31214 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.230711 Jul 20 21:54:50.376896 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 167/322] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:50 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:50.673828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:50.675160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:50.685852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:50.686524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:50.687340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:50.687777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:50.831652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:50.839301 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4f35e04d-8f22-4d7d-b341-d37e5fd8f9d2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.169323 Jul 20 21:54:50.839887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 156/323] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:50 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:51.392926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:51.393572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:51.400544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:51.400997 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:51.401769 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:51.402206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:51.539512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:51.548800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c7a79a1f-9ab6-4ab3-b970-29932fcaa2de tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.159757 Jul 20 21:54:51.549785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 168/324] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:51 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:51.857328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:51.857911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:51.866726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:51.867214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:51.868042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:51.868484 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:52.020606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:52.028352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-768c52c0-7083-4193-b580-ae6389551b35 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.175057 Jul 20 21:54:52.028956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 157/325] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:51 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:52.566107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:52.566834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:52.573100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:52.573539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:52.574301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:52.574727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:52.708533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:52.716982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-52fa6b1a-e7d6-4345-bf36-32c06b78413c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.155033 Jul 20 21:54:52.717546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 169/326] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:52 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:53.044909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:53.045518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:53.052449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:53.052933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:53.053711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:53.054150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:53.208644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:53.217217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-32f31340-bf8c-4bb5-962a-fdb9a7b36389 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.176322 Jul 20 21:54:53.217814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 158/327] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:53 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:53.738948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:53.738948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:53.748683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:53.749182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:53.750004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:53.750437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:53.917909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:53.925950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-087308c2-adac-4930-ab1b-397a5cff0880 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.193398 Jul 20 21:54:53.927470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 170/328] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:53 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:54:54.237578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:54.238365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:54.246374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:54.246824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:54.247619 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:54.248051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:54.338819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:54.395926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:54.404275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1600616d-433d-4396-9e18-8b6eab6ab96f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.170953 Jul 20 21:54:54.404865 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 159/329] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:54 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:54.946212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:54.946848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:54.948752 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:54.949440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:54:54.955549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:54.955999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:54.956780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:54.957220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:55.099159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:55.106789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8375d69c-1aba-45c5-9bc6-b8107b7d94c0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.165213 Jul 20 21:54:55.107395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 171/330] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:54 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:55.421587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:55.422192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:55.429537 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:55.429986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:55.430744 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:55.431202 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:55.565852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:55.573781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-30dc0885-c216-4560-8a7c-01d46661d219 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.156043 Jul 20 21:54:55.574363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 160/331] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:55 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:56.125246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:56.125873 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:56.132725 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:56.135737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:56.135737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:56.135737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:56.228721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-a80b07ad-eea4-4a33-93aa-94480b474af7 req-7edf1dd0-7457-4af9-a219-3303b8ad9c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b18bb-683a-4a73-bab8-494d8532a412", "name": "network-vif-plugged", "status": "completed", "tag": "0231e535-fe69-40cd-96c3-9cd801d67a2e"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:54:56.237775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a80b07ad-eea4-4a33-93aa-94480b474af7 req-7edf1dd0-7457-4af9-a219-3303b8ad9c1a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:56.238903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a80b07ad-eea4-4a33-93aa-94480b474af7 req-7edf1dd0-7457-4af9-a219-3303b8ad9c1a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:56.252949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-a80b07ad-eea4-4a33-93aa-94480b474af7 req-7edf1dd0-7457-4af9-a219-3303b8ad9c1a service nova] Creating event network-vif-plugged:0231e535-fe69-40cd-96c3-9cd801d67a2e for instance 425b18bb-683a-4a73-bab8-494d8532a412 on hv-cinder-84969 Jul 20 21:54:56.259469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-a80b07ad-eea4-4a33-93aa-94480b474af7 req-7edf1dd0-7457-4af9-a219-3303b8ad9c1a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Jul 20 21:54:56.260361 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 161/332] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:54:56.283215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:56.292400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a96ba50d-95d1-4f79-8dc9-713df3a01b05 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.171004 Jul 20 21:54:56.293276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 172/333] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:56 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:56.591474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:56.592084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:56.598912 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:56.599379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:56.600130 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:56.600557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:56.735526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:56.744037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7306b386-4a05-4b73-a124-d3f17f06a24b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.157336 Jul 20 21:54:56.744867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 162/334] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:56 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:57.309881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:57.310526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:57.316729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:57.317217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:57.318071 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:57.318507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:57.454834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:57.464365 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-78703607-d177-4008-a477-e84645372ba5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.158311 Jul 20 21:54:57.464996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 173/335] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:57 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:57.761570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:57.762177 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:57.769200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:57.769822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:57.770769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:57.771360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:57.914170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:57.921689 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-356ac0e8-e51b-4328-8e4c-f04a60c721ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.164188 Jul 20 21:54:57.922260 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 163/336] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:57 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:58.481286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:58.481894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:58.488031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:58.489412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:58.489894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:58.490351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:58.636867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:58.644343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-316f1cd5-7353-491e-8f03-c924c0cc3ee4 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1313 microversion: 2.1 time: 0.166927 Jul 20 21:54:58.645644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 174/337] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:58 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:58.939715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:58.940415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:58.947792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:58.948327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:58.949178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:58.949621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:59.097065 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:59.104583 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-667e4320-4803-4e7c-9620-a43df86f14fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.168787 Jul 20 21:54:59.105160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 164/338] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:58 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:54:59.663210 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:54:59.663823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:54:59.670226 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:59.670713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:59.671553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:54:59.672013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:54:59.822766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:54:59.830701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e6f530f5-ca03-4a70-ab57-e33b09e527ee tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1494 microversion: 2.1 time: 0.172283 Jul 20 21:54:59.831317 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 175/339] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:54:59 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1494 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:00.122325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:00.122931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:00.130465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.130909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.131739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.132201 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.292717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:00.300353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-90fd2cfa-18d8-4a0f-9af4-1a2b35f24f0c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.182162 Jul 20 21:55:00.301082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 165/340] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:00 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:00.570156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:00.570712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:00.576893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.577378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.578167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.578645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.606315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:55:00.636381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:00.699576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a634b03d-296e-40f8-9744-e5d5d8c356d0 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 204 len: 0 microversion: 2.1 time: 0.134056 Jul 20 21:55:00.700450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 176/341] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:55:00 2022] DELETE /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:55:00.714964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:00.716051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:00.722692 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.723272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.724127 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:00.724783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:00.910282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:00.918091 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-51d1b05b-ae42-47d6-998e-0ee0dcfe1381 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1500 microversion: 2.1 time: 0.208399 Jul 20 21:55:00.918669 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 166/342] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:00 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1500 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:01.318445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:01.319167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:01.325437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:01.325890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:01.326749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:01.327215 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:01.522200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:01.532553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2d489085-1240-4a9a-ac9e-8daed362e09a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.218602 Jul 20 21:55:01.542853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 177/343] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:01 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:01.936746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:01.937413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:01.945086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:01.945459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:01.946236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:01.946675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:02.092573 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:02.100781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-32fc89ae-8611-4054-a145-f69aa51fcf7e tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1500 microversion: 2.1 time: 0.167779 Jul 20 21:55:02.101370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 167/344] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:01 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:02.551358 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:02.552450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:02.560010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:02.560586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:02.561464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:02.562003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:02.705988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:02.715048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8d70b6aa-0f0f-4e5f-b227-8fd414b7cec5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.168882 Jul 20 21:55:02.715653 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 178/345] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:02 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:03.119359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:03.120896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:03.127496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:03.128022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:03.128872 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:03.130093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:03.275728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:03.283184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3d29d0c1-43aa-4258-8743-b6689c2cf885 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1500 microversion: 2.1 time: 0.168679 Jul 20 21:55:03.283783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 168/346] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:03 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:03.733966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:03.740242 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:03.746742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:03.747231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:03.747990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:03.748414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:03.993772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:04.011991 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-eeed55ef-5233-4301-af78-2fb717609988 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.282065 Jul 20 21:55:04.012586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 179/347] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:03 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:04.305399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:04.306700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:04.320675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:04.321468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:04.322481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:04.323783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:04.809532 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:04.819775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c3089986-1762-4c7e-9d1e-47fb636bdb57 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1458 microversion: 2.1 time: 0.521421 Jul 20 21:55:04.820789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 169/348] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:04 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1458 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:04.902328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-d492e74d-2bfd-4a50-8187-58dc6cd4acd5 req-dc87365e-acfb-4c81-a785-e03b405ae754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b18bb-683a-4a73-bab8-494d8532a412", "name": "network-vif-deleted", "tag": "0231e535-fe69-40cd-96c3-9cd801d67a2e"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:04.918435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d492e74d-2bfd-4a50-8187-58dc6cd4acd5 req-dc87365e-acfb-4c81-a785-e03b405ae754 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:04.919357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d492e74d-2bfd-4a50-8187-58dc6cd4acd5 req-dc87365e-acfb-4c81-a785-e03b405ae754 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:04.946406 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-d492e74d-2bfd-4a50-8187-58dc6cd4acd5 req-dc87365e-acfb-4c81-a785-e03b405ae754 service nova] Creating event network-vif-deleted:0231e535-fe69-40cd-96c3-9cd801d67a2e for instance 425b18bb-683a-4a73-bab8-494d8532a412 on hv-cinder-84969 Jul 20 21:55:04.955407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-d492e74d-2bfd-4a50-8187-58dc6cd4acd5 req-dc87365e-acfb-4c81-a785-e03b405ae754 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064118 Jul 20 21:55:04.956388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 180/349] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:05.036894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:05.037519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:05.043700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:05.044473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:05.045482 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:05.045910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:05.196362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:05.204656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ab1d4f2e-b042-44ef-9eea-7dd3c0b03a8e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.172051 Jul 20 21:55:05.205172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 170/350] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:05 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:05.837897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:05.838617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:05.845173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:05.845658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:05.846557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:05.847082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:05.884852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:05.885046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:05.885536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lazy-loading 'fault' on Instance uuid 425b18bb-683a-4a73-bab8-494d8532a412 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:55:05.945770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:05.953771 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e3d254de-1403-438b-a5d0-a4d1a80d29c5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1303 microversion: 2.1 time: 0.120429 Jul 20 21:55:05.954379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 181/351] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:05 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:06.221480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:06.222188 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:06.230679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:06.231213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:06.232017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:06.232485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:06.236855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:06.374806 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:06.388040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4e623a2e-e107-458c-8bee-6f0fd34530d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.166336 Jul 20 21:55:06.388040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 171/352] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:06 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:06.970435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:06.971048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:06.977538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:06.977986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:06.978755 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:06.979217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:07.012566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:07.013016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:07.013458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lazy-loading 'fault' on Instance uuid 425b18bb-683a-4a73-bab8-494d8532a412 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:55:07.060156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:07.068656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a20ab1e5-3f9e-40ff-9720-3fc344974439 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1303 microversion: 2.1 time: 0.102015 Jul 20 21:55:07.069438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 182/353] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:06 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:07.401067 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:07.401600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:07.408052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:07.408507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:07.409290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:07.409739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:07.553102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:07.560856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c068b182-702b-4b7e-8085-81e1527bb934 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.163672 Jul 20 21:55:07.561440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 172/354] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:07 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:08.086045 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:08.086764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:08.093425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:08.093872 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:08.094647 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:08.095109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:08.127403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:08.127853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:08.128316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lazy-loading 'fault' on Instance uuid 425b18bb-683a-4a73-bab8-494d8532a412 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:55:08.170654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:08.179161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ae7517db-fc2e-4e7f-8fa3-b59d3b202b0c tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1303 microversion: 2.1 time: 0.097176 Jul 20 21:55:08.179750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 183/355] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:08 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:08.578436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:08.579033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:08.586047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:08.586496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:08.587277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:08.587718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:08.732673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:08.741094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4a02ba0d-27bb-4e69-92d5-ede0cfa1c2c0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.166516 Jul 20 21:55:08.741649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 173/356] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:08 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:09.196867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:09.197414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:09.203607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:09.204054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:09.204811 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:09.205236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:09.237737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:09.238727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:09.239285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lazy-loading 'fault' on Instance uuid 425b18bb-683a-4a73-bab8-494d8532a412 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:55:09.283656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c901aba30d141b39e7189eefc7c1ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43767d64494137af74bbb2955ef55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:09.291751 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2fe66781-2451-49c3-9597-d8003b1be38d tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 200 len: 1303 microversion: 2.1 time: 0.098707 Jul 20 21:55:09.292342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 184/357] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:09 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:09.757593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:09.758214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:09.764818 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:09.765276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:09.766043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:09.766485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:09.896526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:09.904596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2e04d6d0-d9a8-422b-baab-aee22f4e4429 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.150723 Jul 20 21:55:09.905256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 174/358] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:09 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:10.309809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:10.310413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] [instance: 425b18bb-683a-4a73-bab8-494d8532a412] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:10.317062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:10.318000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:10.318762 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:10.319228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:10.333317 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] HTTP exception thrown: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Request method failure captured: Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 HTTP/1.1 Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hlr8etTi1T623FkMeUp6Lqw1IWNi1O-jaS54sKqexJK2UwDiePWMSI1NiK76pNcY3pwVDdUcnxnCdzU9k4FMm9f8pjaqNmb49xx8XNEKVzjC6gSsfQE7xd-TB7U7mQzOV2gRyskBUJTVJDa_kInph7XJq6HCsd1LY_aIur7PV1Nn3I Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 9a43767d64494137af74bbb2955ef55a Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesActionsTest-134536421 Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:55:10.334939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9a43767d64494137af74bbb2955ef55a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9a43767d64494137af74bbb2955ef55a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a43767d64494137af74bbb2955ef55a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a43767d64494137af74bbb2955ef55a"}]}] Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesActionsTest-134536421 Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 9a43767d64494137af74bbb2955ef55a Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesActionsTest-134536421 Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesActionsTest-134536421-project Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 9c901aba30d141b39e7189eefc7c1ce1 Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesActionsTest-134536421-project Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. Jul 20 21:55:10.336299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '425b18bb-683a-4a73-bab8-494d8532a412'} Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:55:10.336969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. Jul 20 21:55:10.338687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:10.340030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] Returning 404 to user: Instance 425b18bb-683a-4a73-bab8-494d8532a412 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:55:10.340030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-33f353f2-f9cc-4e4d-8da1-6f8d385c10b5 tempest-VolumesActionsTest-134536421 tempest-VolumesActionsTest-134536421-project] 10.222.0.86 "GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412" status: 404 len: 111 microversion: 2.1 time: 0.030402 Jul 20 21:55:10.340030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 185/359] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:10 2022] GET /compute/v2.1/servers/425b18bb-683a-4a73-bab8-494d8532a412 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:55:10.924494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:10.925151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:10.933106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:10.933649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:10.934488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:10.935042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:11.080284 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:11.088782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-aab5fee2-29e0-4609-9ef4-e5c027a304ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.168180 Jul 20 21:55:11.089370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 175/360] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:10 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:12.111692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:12.112468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:12.120479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:12.121243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:12.122361 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:12.123263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:12.265854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:12.273445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-18740e6f-7b93-4cd5-bd48-0fa0567f64fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.169787 Jul 20 21:55:12.274010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 186/361] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:12 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:13.290226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:13.290976 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:13.297876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:13.298328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:13.299129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:13.299568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:13.437415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:13.446221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c865ed56-cabc-420f-83ec-71a5ab5dcf21 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.159890 Jul 20 21:55:13.446793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 176/362] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:13 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:14.463424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:14.463940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:14.469940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:14.470385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:14.471165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:14.471594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:14.601669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:14.609092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-42e1fc53-ecbc-4e9e-9c1b-ea74c9b530e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.149593 Jul 20 21:55:14.609651 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 187/363] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:14 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:15.626452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:15.627135 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:15.629778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=52 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:15.635732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:15.636178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:15.636939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:15.637374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:15.774254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:15.783503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0fa6c6a8-66d0-47ea-a5f7-9d0ecd224d94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.161208 Jul 20 21:55:15.784424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 177/364] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:15 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:16.801674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:16.802279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:16.804965 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:16.810603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:16.811052 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:16.811822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:16.812397 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:16.955930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:16.965359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c2b10af1-d8f5-4968-9266-5bbd9da5e58e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.167462 Jul 20 21:55:16.966044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 188/365] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:16 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:17.981968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:17.983335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:17.990009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:17.990605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:17.992772 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:17.993689 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:18.139295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:18.148097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2f3a2228-6d1a-441e-90b2-a81add085358 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.169933 Jul 20 21:55:18.148836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 178/366] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:17 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:19.165619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:19.166266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:19.178673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:19.179139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:19.179930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:19.180534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:19.403345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:19.422855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1856639c-4c44-48c7-aa82-5fe22f7531ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.260881 Jul 20 21:55:19.424194 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 189/367] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:19 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:20.467896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:20.467896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:20.467896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:20.467896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:20.468570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:20.468570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:20.635512 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:20.643948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c30c9bfc-505c-40d6-b447-c919c65faa81 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.207099 Jul 20 21:55:20.644790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 179/368] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:20 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:21.661088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:21.661623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:21.667831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:21.668285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:21.669040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:21.669477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:21.801677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:21.809726 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-14a4371d-aa82-479b-94af-9534d797de5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.152593 Jul 20 21:55:21.810287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 190/369] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:21 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:22.827382 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:22.828822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:22.835608 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:22.836073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:22.836870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:22.837820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:23.043399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:23.052119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b64ce00b-3c25-4886-86b4-c0b567369cf2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.228845 Jul 20 21:55:23.053009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 180/370] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:22 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:24.069558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:24.070175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:24.077181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:24.077872 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:24.078862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:24.079466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:24.226306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:24.234938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-184be5c5-7cf8-4500-bb69-5a3820632d16 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.169118 Jul 20 21:55:24.245493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 191/371] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:24 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:25.252469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:25.253336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:25.259905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.260364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.261129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.261777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.465203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:25.480269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3c50152c-f01d-471f-a0a8-2df1e2175a2a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1500 microversion: 2.1 time: 0.231531 Jul 20 21:55:25.480867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 181/372] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:25 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:25.510944 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39d93a6d-2c45-4510-92a9-733645d6b6d3"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:25.513591 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:25.527962 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.529425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.531039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.532051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.580967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:25.588364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] HTTP exception thrown: Cannot 'attach_volume' instance 18ae5df2-b95e-4408-94a0-c75f87543061 while it is in vm_state rescued Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Request method failure captured: Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/os-volume_attachments HTTP/1.1 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 74 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk6rdg9RgXTwJ4yevFyc3pHFPX4zPiiCC8ZK0Y8Rr_6nca1sdd-TXSJWznYPm2PhbvMRrBgJ7BfLGdS8f3tlvKSsU44by5miUt1w4ySdqLYYmFR373GWJ8kWQyt-Gty7rF4rBS3AnUmxsWqin4j5RcqWQghoar5cdQTNi4dVlqEGW4 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:55:25.593921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_80320a3595ce4d4cb7c468b0fbec6580", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}] Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 1a0d4ce0ac4d47c8a184ea0291461379 Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {"volumeAttachment": {"volumeId": "39d93a6d-2c45-4510-92a9-733645d6b6d3"}} Jul 20 21:55:25.596789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Cannot 'attach_volume' instance 18ae5df2-b95e-4408-94a0-c75f87543061 while it is in vm_state rescued Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'server_id': '18ae5df2-b95e-4408-94a0-c75f87543061', 'body': {'volumeAttachment': {'volumeId': '39d93a6d-2c45-4510-92a9-733645d6b6d3'}}} Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:55:25.598882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 18ae5df2-b95e-4408-94a0-c75f87543061 while it is in vm_state rescued Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:55:25.602817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 18ae5df2-b95e-4408-94a0-c75f87543061 while it is in vm_state rescued Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Returning 409 to user: Cannot 'attach_volume' instance 18ae5df2-b95e-4408-94a0-c75f87543061 while it is in vm_state rescued {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-09bb6484-cb9e-4ac1-a063-413ac8bd98c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093064 Jul 20 21:55:25.607308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 192/373] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:55:25 2022] POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 21:55:25.614776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:25.615769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:25.630388 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.631967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.633589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.634637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.730163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-45cf1e1a-f230-4a1a-828e-3c326e452c0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/action" status: 202 len: 0 microversion: 2.1 time: 0.121250 Jul 20 21:55:25.731696 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 182/374] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:55:25 2022] POST /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:55:25.747855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:25.748888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:25.775706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.777058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:25.782905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:25.783711 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:26.090818 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:26.101657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c625b3f4-f4c4-4391-a144-bf11780edce8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1508 microversion: 2.1 time: 0.363796 Jul 20 21:55:26.108871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 193/375] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:25 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:27.124679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:27.126143 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:27.132982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:27.134271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:27.135358 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:27.135890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:27.340362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:27.361414 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-993762f3-27cf-4c8e-bfda-6b094934f93a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1508 microversion: 2.1 time: 0.241487 Jul 20 21:55:27.362524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 183/376] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:27 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:28.380932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:28.381482 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:28.389579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:28.390359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:28.391696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:28.392292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:28.560705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:28.573170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6f173b00-92b7-4987-92b7-15976e94ac5f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1508 microversion: 2.1 time: 0.193062 Jul 20 21:55:28.582660 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 194/377] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:28 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:29.591221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:29.592494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:29.603570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:29.608805 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:29.612595 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:29.613065 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:29.839227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:29.848878 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-48f03a12-249b-441b-beba-ec7b1ef2b32e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1508 microversion: 2.1 time: 0.261393 Jul 20 21:55:29.849989 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 184/378] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:29 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:30.866781 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:30.868244 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:30.875390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:30.875851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:30.876939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:30.877383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:31.068851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:31.096976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-efe37b2a-5b97-42b0-9f5e-95fe9b92dae2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1514 microversion: 2.1 time: 0.234316 Jul 20 21:55:31.099727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 195/379] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:30 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:32.825439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4155b0db-8f09-4d45-af49-bde1c9821566 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: .version_select at 0x7f6aba7ed9d0>, body: {"keypair": {"name": "tempest-keypair-1620262144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUWzfUEyWtwsuDIUE4X43FiqTfe7XXE3ZedX4LfGAG72DF8vm3p9ieQIHgxOlw5h8MpYMGPc9ymwHG9PTCyU15Mn+vjxXBugd9Zm6yTMVTUoJrWljKdHVFXOBAHW6Rhog=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:32.851219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-4155b0db-8f09-4d45-af49-bde1c9821566 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:55:32.856232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-4155b0db-8f09-4d45-af49-bde1c9821566 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for user 1a0d4ce0ac4d47c8a184ea0291461379 and project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:55:32.885185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4155b0db-8f09-4d45-af49-bde1c9821566 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063418 Jul 20 21:55:32.886458 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 185/380] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:55:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:34.912937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1709761294", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3eef71be-0bf3-4fa0-b902-6d7954148e3f"}], "security_groups": [{"name": "tempest-securitygroup--882925918"}], "key_name": "tempest-keypair-1620262144", "user_data": "}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:35.032620 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] validate_networks() for [('3eef71be-0bf3-4fa0-b902-6d7954148e3f', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:55:35.479884 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:55:35.480553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:55:35.481307 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:55:35.481855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:55:35.482812 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:55:35.493343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:35.494021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:35.494941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:35.495864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:35.515355 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:55:35.519627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Getting quotas for user 1a0d4ce0ac4d47c8a184ea0291461379 and project 80320a3595ce4d4cb7c468b0fbec6580. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:55:35.532654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:55:35.534935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:55:35.587555 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-600272d2-1707-44e7-8d14-996a19f93cbe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.678805 Jul 20 21:55:35.588506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 196/381] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:55:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 21:55:35.598582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9f49557f-b6e6-4c06-9247-c0cf8eb57d20 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:35.616028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9f49557f-b6e6-4c06-9247-c0cf8eb57d20 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:35.686973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9f49557f-b6e6-4c06-9247-c0cf8eb57d20 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:35.696823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9f49557f-b6e6-4c06-9247-c0cf8eb57d20 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1246 microversion: 2.1 time: 0.100751 Jul 20 21:55:35.697480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 186/382] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:35 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:36.714784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:36.715540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:36.722437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:36.722878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:36.723761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:36.724230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:36.795475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:36.806974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-83007f47-be43-49b3-aa43-c56b3e4a1a73 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1250 microversion: 2.1 time: 0.096745 Jul 20 21:55:36.808363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 197/383] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:36 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:37.827162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:37.827769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:37.841984 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:37.842451 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:37.846301 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:37.847001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:37.868638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:37.952339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:37.969131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f3990a17-a541-40d6-be3e-b13d3df0396f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1242 microversion: 2.1 time: 0.149009 Jul 20 21:55:37.971980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 187/384] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:37 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:38.989564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:38.990923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:38.999908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:39.000714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:39.001712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:39.002453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:39.078888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:39.091773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-817f895b-8043-40e9-88cd-fa46bfe7f6ee tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1304 microversion: 2.1 time: 0.105979 Jul 20 21:55:39.102690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 198/385] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:38 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:40.110290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:40.110902 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:40.118778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:40.119266 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:40.120036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:40.120775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:40.183046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:40.190458 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c0443547-0ae5-4516-aa75-d9f98acb92e4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1304 microversion: 2.1 time: 0.084028 Jul 20 21:55:40.191021 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 188/386] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:40 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:41.146809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:41.147389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:41.153432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.153884 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.154645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.155098 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.177290 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5c4089bf-9e6c-4021-a20f-0c14ceaf9672 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/ips" status: 200 len: 145 microversion: 2.1 time: 0.034301 Jul 20 21:55:41.177840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 199/387] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:55:41 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:41.206749 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:41.207397 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:41.214309 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.214758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.215543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.215978 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.278345 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:41.286026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-aed180a1-f289-4e69-9aef-3a6393068a4e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1304 microversion: 2.1 time: 0.083081 Jul 20 21:55:41.286590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 189/388] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:41 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:41.612183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:41.612670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:41.619840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.620550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.621300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:41.621727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:41.644280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-15bdde61-c8d9-4fa0-a603-f3388fb352d6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/ips" status: 200 len: 151 microversion: 2.20 time: 0.035989 Jul 20 21:55:41.644908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 200/389] 10.222.0.86 () {60 vars in 1288 bytes} [Wed Jul 20 21:55:41 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:55:42.304056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:42.304724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:42.312499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:42.312958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:42.313759 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:42.314184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:42.379565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:42.388597 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2f2674c0-87e7-4e9a-a36d-b95ccb74a0c9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1304 microversion: 2.1 time: 0.088402 Jul 20 21:55:42.389187 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 190/390] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:42 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:43.405444 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:43.406029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:43.412258 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:43.412709 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:43.413489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:43.414460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:43.515698 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:43.525833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-57774564-cbb8-4e05-8401-cb6ee0a9f939 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1304 microversion: 2.1 time: 0.124268 Jul 20 21:55:43.526996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 201/391] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:43 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:44.339809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4522c8fe-de70-4348-acbd-0a68c3c2ae4e"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:44.341751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:44.350238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:44.352828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:44.353680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:44.354289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:44.548807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:44.553201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:44.577007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:44.578005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:44.580779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:44.581204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:45.112473 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:45.122499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0c4810a5-a4d1-4c76-8bf2-381381b4a558 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.581739 Jul 20 21:55:45.123426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 202/392] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:44 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:45.317388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-85959c09-c12e-4005-81f4-c4be5648a695 req-9897d8a9-7977-427e-b782-a2fdf7e4158c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:45.333729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-85959c09-c12e-4005-81f4-c4be5648a695 req-9897d8a9-7977-427e-b782-a2fdf7e4158c service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:45.334175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-85959c09-c12e-4005-81f4-c4be5648a695 req-9897d8a9-7977-427e-b782-a2fdf7e4158c service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:45.347295 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-85959c09-c12e-4005-81f4-c4be5648a695 req-9897d8a9-7977-427e-b782-a2fdf7e4158c service nova] Creating event network-changed:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:55:45.352996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-85959c09-c12e-4005-81f4-c4be5648a695 req-9897d8a9-7977-427e-b782-a2fdf7e4158c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039573 Jul 20 21:55:45.353593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 203/393] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:45.691756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:45.785023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:45.785902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:45.792371 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:45.793007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:45.802954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:45.803465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:45.804235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:45.805418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:45.829122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lazy-loading 'flavor' on Instance uuid 6f8a564c-d369-4d26-836f-0d5498d8cbc9 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:55:46.100402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-20ae93b7-e3a6-4a82-8b12-6f623ff1dda1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/action" status: 202 len: 0 microversion: 2.20 time: 0.316455 Jul 20 21:55:46.101035 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 204/394] 10.222.0.86 () {62 vars in 1318 bytes} [Wed Jul 20 21:55:45 2022] POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 21:55:46.113492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:46.114292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:46.122470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:46.122895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:46.123705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:46.124132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:46.262335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:46.273455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:46.275808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:46.277562 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-875a61ed-c4b6-4467-89aa-7f1089e80ea2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.170220 Jul 20 21:55:46.278376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 205/395] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:46 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:46.284747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:46.285657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:46.292678 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:46.293133 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:46.293896 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:46.294331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:46.430780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:46.441086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5c33523a-d278-4ce3-86cf-c2ce5fb92037 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.161201 Jul 20 21:55:46.441826 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 206/396] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:46 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:47.295825 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:47.296429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:47.298395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:47.303759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:47.304258 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:47.304998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:47.305421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:47.443753 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:47.452722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:47.454721 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:47.456161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-12bce8e7-c994-4069-b244-5d5daefd2b90 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.164096 Jul 20 21:55:47.456840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 207/397] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:47 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:55:47.462541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:47.463271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:47.470881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:47.471479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:47.472417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:47.472954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:47.609996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:47.617742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1885ef79-88ff-4b2d-ad83-2450e2459793 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.159824 Jul 20 21:55:47.618312 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 208/398] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:47 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:48.475847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:48.477182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:48.483292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:48.483742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:48.484505 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:48.484967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:48.503708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:48.635882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:48.644535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:48.646557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:48.648546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-884ca66b-ed85-4c56-a824-f59b6037660f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.176138 Jul 20 21:55:48.659178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 209/399] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:48 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:48.663282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:48.664906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:48.671926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:48.673048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:48.674334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:48.674851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:48.844253 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-21ec8486-c376-49d5-866a-84721e6126a3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.508808 Jul 20 21:55:48.845349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 191/400] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:55:44 2022] POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments => generated 194 bytes in 4512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:48.890349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:48.900426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e4895060-ff99-424f-8e30-f3cf4f52e83a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.249992 Jul 20 21:55:48.901615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 210/401] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:48 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:49.670967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:49.671698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:49.673820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:55:49.680910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:49.681371 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:49.682207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:49.682827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:49.921759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:49.922478 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:49.932110 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:49.933283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:49.933765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:49.937367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:49.938099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:49.953147 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:49.958248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:49.959585 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1d751197-4407-4c2f-87cb-7996ae12ee88 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.293712 Jul 20 21:55:49.961304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 192/402] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:49 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:50.207789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:50.223990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-378e8485-6362-4dce-947e-d08253bac899 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.307121 Jul 20 21:55:50.224607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 211/403] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:49 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:50.979638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:50.981082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:50.989768 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:50.990221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:50.991239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:50.991624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:51.182645 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:51.190998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:51.192539 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:51.193758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-67287c80-5807-4396-8184-d38d5c6e8b3d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.218847 Jul 20 21:55:51.194658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 193/404] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:50 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:51.244392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:51.245580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:51.252066 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:51.255160 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:51.255970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:51.256418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:51.441929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:51.451645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d114a41c-7158-4b9f-b777-4eba2bac71bb tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.211782 Jul 20 21:55:51.452599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 212/405] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:51 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:52.217990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:52.218642 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:52.226190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:52.227341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:52.228322 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:52.228953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:52.395144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:52.404794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:52.406379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:52.407612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8cf09f22-24c9-4e65-84e9-b3ebea3750df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.193639 Jul 20 21:55:52.408391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 194/406] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:52 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:52.471723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:52.472532 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:52.482196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:52.483014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:52.483805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:52.484241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:52.724800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:52.737304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6e78f6d3-4d12-4191-8af2-07502d5e94f5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.269259 Jul 20 21:55:52.744961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 213/407] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:52 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:53.441846 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:53.442908 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:53.470168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:53.470721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:53.472078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:53.472654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:53.687941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:53.699962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:53.701760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:53.706193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d36a4152-4c79-42bc-9615-1dfe91c39bed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.281412 Jul 20 21:55:53.716096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 195/408] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:53 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:53.758389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:53.759137 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:53.766650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:53.767130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:53.767911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:53.768514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:53.942781 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:53.951525 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-24d4affc-e042-49ed-92e2-9f017b7c257d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.199315 Jul 20 21:55:53.952104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 214/409] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:53 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:54.725269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:54.725897 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:54.738672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:54.739570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:54.740796 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:54.741487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:54.920115 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:54.930722 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:54.932778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:54.934209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-18aaed83-f7c1-44ee-8bf3-4b1fc0c632cf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.212917 Jul 20 21:55:54.935257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 196/410] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:54 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:54.969831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:54.970427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:54.976877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:54.977449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:54.978438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:54.978873 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:55.144861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:55.153000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ffb62849-0937-4049-9b92-8feb525db06c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.187336 Jul 20 21:55:55.155129 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 215/411] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:54 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:55.955736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:55.956594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:55.965248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:55.965701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:55.966666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:55.967452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:56.112816 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:56.122731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:56.124697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:56.125896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-14c7c2bf-c5c2-4fb7-a4fe-393fafea2f99 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.174235 Jul 20 21:55:56.126494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 197/412] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:55 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:55:56.175314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:56.176899 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:56.184686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:56.185235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:56.186045 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:56.186485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:56.380846 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:56.389275 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a93fd2b2-8a07-4b80-9d3f-d72d4da95d88 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.220903 Jul 20 21:55:56.390441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 216/413] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:56 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:57.151637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:57.152224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:57.154555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-93d89690-a95c-4d4c-8f2e-a17a25442825 req-12e559b8-bd2a-4057-b4c8-8f69c0376335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "name": "network-vif-plugged", "status": "completed", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:57.173421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.173931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.174736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.180201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.192756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-93d89690-a95c-4d4c-8f2e-a17a25442825 req-12e559b8-bd2a-4057-b4c8-8f69c0376335 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.193374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-93d89690-a95c-4d4c-8f2e-a17a25442825 req-12e559b8-bd2a-4057-b4c8-8f69c0376335 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.224141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-93d89690-a95c-4d4c-8f2e-a17a25442825 req-12e559b8-bd2a-4057-b4c8-8f69c0376335 service nova] Creating event network-vif-plugged:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:55:57.242059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-93d89690-a95c-4d4c-8f2e-a17a25442825 req-12e559b8-bd2a-4057-b4c8-8f69c0376335 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101403 Jul 20 21:55:57.247483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 198/414] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:55:57.411268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:57.411988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:57.449949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.452494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.460507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.461579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.666170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:57.676832 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:57.682950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:57.689199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8dc6934f-619d-4f9a-950f-1649cf3f1082 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.544987 Jul 20 21:55:57.690159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 217/415] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:57 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:57.785528 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6c6a2b91-4dfb-443a-91d7-1a51a0ca7581 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:55:57.793627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6a2b91-4dfb-443a-91d7-1a51a0ca7581 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.794392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6a2b91-4dfb-443a-91d7-1a51a0ca7581 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.801242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:57.815487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7f7b5f0e-6f3a-4b91-bb7c-d9a946320349 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.410687 Jul 20 21:55:57.817429 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 199/416] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:57 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:57.863036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6c6a2b91-4dfb-443a-91d7-1a51a0ca7581 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Going to try to stop instance {{(pid=124151) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 21:55:57.926173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6c6a2b91-4dfb-443a-91d7-1a51a0ca7581 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action" status: 202 len: 0 microversion: 2.1 time: 0.144469 Jul 20 21:55:57.930186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 218/417] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:55:57 2022] POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:55:57.936710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:57.937779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:57.950235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.951789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:57.953437 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:57.954458 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:58.174998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:58.198398 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d5ad662a-5a69-4458-93fd-090330bba5e2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.266625 Jul 20 21:55:58.199701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 200/418] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:57 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:55:58.721391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:58.723153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:58.730246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:58.731095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:58.732291 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:58.732877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:58.843471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:58.844781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:58.864096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:58.864706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:58.867801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:58.868440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:58.924115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:58.941076 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:58.944079 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:58.946744 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-87673bdc-8c69-4066-af88-05dbb62d8e6f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.229609 Jul 20 21:55:58.948299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 219/419] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:58 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:55:59.058684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:59.067191 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-24cb77ec-5db7-47b2-ac3d-25d6f8a6b4b3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.230213 Jul 20 21:55:59.068483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 201/420] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:58 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:59.225070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:59.226560 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:59.236034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:59.238773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:59.240765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:59.241995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:59.409062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:55:59.422515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a0ecb6a9-16f6-497c-821c-3853dea45703 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.201198 Jul 20 21:55:59.423442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 220/421] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:55:59 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:55:59.969719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:55:59.970943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:55:59.989655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:59.990116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:55:59.990919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:55:59.991375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:00.093476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:00.094087 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:00.113449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:00.113903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:00.114691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:00.134471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:00.326808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:00.341932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:00.344379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:00.345678 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4c70595c-4e1f-4727-b4a9-b20098819f5c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.380643 Jul 20 21:56:00.357820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 202/422] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:55:59 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:00.417576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:00.430425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4ea6c99c-5f5f-45cf-b298-0a343894c408 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1371 microversion: 2.1 time: 0.342313 Jul 20 21:56:00.431898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 221/423] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:00 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:00.440686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:00.441658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:00.448376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:00.448881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:00.449838 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:00.450274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:00.455152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:00.612708 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:00.622521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c8fc9606-a8d9-4b5d-89ea-31b7a11c40bb tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.186225 Jul 20 21:56:00.623126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 203/424] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:00 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:01.365476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:01.367430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:01.382830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:01.383605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:01.385743 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:01.386932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:01.435108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1641572880", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:01.504016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] validate_networks() for None {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:56:01.666133 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:01.677626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:01.679707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:01.684048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9dfda9a6-7d82-4102-938c-bad3ea52298f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.323195 Jul 20 21:56:01.684911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 222/425] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:01 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:01.704258 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:01.708919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:01.717926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:01.718610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:01.720180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:01.720810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.301502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:02.312716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9f021e7f-09bd-4a06-836a-0d1a78709599 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1565 microversion: 2.1 time: 0.612761 Jul 20 21:56:02.322349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:56:02.322349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:56:02.322510 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:56:02.323366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:56:02.324464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:56:02.325523 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 223/426] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:01 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1565 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:02.331536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:02.332827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:02.340180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.340624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.341391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.341820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.344880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.345622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.346956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.349617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.386542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Getting quotas for project b4eb21113d83407db43d77aafcb5a33c. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:56:02.393773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Getting quotas for user c9b96b7a3a2142528dd94d5eaf8de9aa and project b4eb21113d83407db43d77aafcb5a33c. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:56:02.412380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:56:02.416702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:56:02.489965 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [954578dc-a9c1-484b-a9c0-6618a2b30141] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 21:56:02.577984 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:02.586893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-20be0fd2-2d4b-46cc-9dfb-7befc4bc39b1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.260120 Jul 20 21:56:02.588147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 224/427] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:02 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:02.593843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:02.594677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:02.606980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.608156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.609273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.609777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.614170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:02.698018 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d3ba60e0-c2ae-4d67-af5b-2927c30e2c34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108287 Jul 20 21:56:02.698760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 225/428] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:56:02 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:02.703724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:02.704344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:02.712043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.712498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.713269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:02.713850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:02.901247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:02.909593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:02.911148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:02.912319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8d768b10-aeb8-4a62-8db5-d2602bfc6bee tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.212575 Jul 20 21:56:02.913050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 226/429] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:02 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:03.499581 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [954578dc-a9c1-484b-a9c0-6618a2b30141] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 57082. Jul 20 21:56:03.512881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c2cca713-39d9-4f54-96cb-0755b18b6886 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081552 Jul 20 21:56:03.522172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 204/430] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:56:03.532477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d679c487-f03e-4645-8371-a259d0f7de4f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:03.533313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d679c487-f03e-4645-8371-a259d0f7de4f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:03.616028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:03.618886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:03.651982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:03.656408 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:03.657798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:03.664724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:03.780972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d679c487-f03e-4645-8371-a259d0f7de4f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:03.794067 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d679c487-f03e-4645-8371-a259d0f7de4f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1215 microversion: 2.1 time: 0.269217 Jul 20 21:56:03.810976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 227/431] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:03 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1215 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:03.934495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:03.935172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:03.946167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:03.946626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:03.958472 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:03.963286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:04.131111 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:04.142702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d62087ee-4627-4680-b2d3-35555e98e3a9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.535133 Jul 20 21:56:04.161544 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 205/432] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:03 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:04.233588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-f2f1d0fe-6c53-4443-96b9-c9933879af0f req-11b9db2c-48b6-409e-868b-22eb57a55d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:04.244045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-f2f1d0fe-6c53-4443-96b9-c9933879af0f req-11b9db2c-48b6-409e-868b-22eb57a55d11 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:04.244503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-f2f1d0fe-6c53-4443-96b9-c9933879af0f req-11b9db2c-48b6-409e-868b-22eb57a55d11 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:04.264953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-f2f1d0fe-6c53-4443-96b9-c9933879af0f req-11b9db2c-48b6-409e-868b-22eb57a55d11 service nova] Creating event network-changed:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:56:04.284076 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-f2f1d0fe-6c53-4443-96b9-c9933879af0f req-11b9db2c-48b6-409e-868b-22eb57a55d11 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055087 Jul 20 21:56:04.284975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 206/433] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:56:04.405351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:04.423527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:04.426142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:04.430642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3d23506b-f8b2-407b-bf87-a33b3b71421e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.502676 Jul 20 21:56:04.433478 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 228/434] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:03 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:04.819029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:04.821142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:04.837160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:04.837895 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:04.839023 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:04.839534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:04.971763 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:04.981376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6ae4732c-ca22-468a-9128-4e8a0aa84852 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1267 microversion: 2.1 time: 0.166482 Jul 20 21:56:04.987225 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 207/435] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:04 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:05.165941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:05.166618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:05.176625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:05.177366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:05.178414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:05.179153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:05.454813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:05.455476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:05.464785 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:05.467816 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:05.476837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:05.483222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:05.750513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:05.765143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-057ea14d-2b4c-42bf-a951-af6953ec054a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.604052 Jul 20 21:56:05.765758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 229/436] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:05 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:05.990732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:06.007992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:06.016762 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:06.016762 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:06.019024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:06.020886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4994aa4a-bcf7-427f-8447-afa48b455c50 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.572020 Jul 20 21:56:06.021666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 208/437] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:05 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:06.036800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:06.037574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:06.039006 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:06.039788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:06.165740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:06.179402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-98c2b932-7a49-43b1-a0f5-3635cd39f31e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1273 microversion: 2.1 time: 0.172441 Jul 20 21:56:06.182741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 230/438] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:06 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:06.784439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:06.785469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:06.795792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:06.798771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:06.799891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:06.802988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:07.048117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:07.049030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:07.077370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:07.077956 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:07.078875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:07.079351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:07.156494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:07.165521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-08ff91a0-6f23-4a10-ae78-5f7307ce3446 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.385130 Jul 20 21:56:07.178241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 209/439] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:06 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:07.201717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:07.207202 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:07.220008 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:07.220823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:07.226275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:07.227644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:07.586841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:07.619677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f93d5efd-d5f0-40e7-83cd-fd889ea8d994 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1273 microversion: 2.1 time: 0.424551 Jul 20 21:56:07.623296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 210/440] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:07 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1273 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:07.947817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:07.960809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:07.963356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:07.964809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-92f2748d-16ab-4ba3-bea3-a143da367070 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.920863 Jul 20 21:56:07.965697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 231/441] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:07 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:08.212265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:08.213058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:08.229159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:08.229839 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:08.230776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:08.231703 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:08.645870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:08.647369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:08.656192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:08.656858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:08.657839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:08.658479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:08.727276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:08.736507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8bd18d50-542b-4df3-93eb-e103b84141d9 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.530786 Jul 20 21:56:08.737492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 211/442] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:08 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:08.994090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:08.994890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:09.010559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:09.011733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:09.013005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:09.015605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:09.060081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:09.088414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-40de230e-bfac-4c45-ac1b-7339b236394b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.449559 Jul 20 21:56:09.102702 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 232/443] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:08 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:09.390421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:09.407577 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:09.409747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:09.416288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0336772e-164a-46b9-9269-29402748d7c8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.425441 Jul 20 21:56:09.417435 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 212/444] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:08 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:09.520663 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-60124bdc-5a24-4eb5-b614-c5d63fa0e2b0 req-6e9c8cd1-1fc6-4dea-8904-81b6e70d7cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382e5c68-07b5-4609-8115-3274fed99407", "tag": "bf362a45-0286-49b4-ae07-a2b6365512d4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:09.530187 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-60124bdc-5a24-4eb5-b614-c5d63fa0e2b0 req-6e9c8cd1-1fc6-4dea-8904-81b6e70d7cc3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:09.530879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-60124bdc-5a24-4eb5-b614-c5d63fa0e2b0 req-6e9c8cd1-1fc6-4dea-8904-81b6e70d7cc3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:09.552165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-60124bdc-5a24-4eb5-b614-c5d63fa0e2b0 req-6e9c8cd1-1fc6-4dea-8904-81b6e70d7cc3 service nova] Creating event network-changed:bf362a45-0286-49b4-ae07-a2b6365512d4 for instance 382e5c68-07b5-4609-8115-3274fed99407 on hv-cinder-84969 Jul 20 21:56:09.564486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-60124bdc-5a24-4eb5-b614-c5d63fa0e2b0 req-6e9c8cd1-1fc6-4dea-8904-81b6e70d7cc3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047756 Jul 20 21:56:09.565107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 233/445] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:09.754131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:09.754969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:09.773934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:09.782111 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:09.782966 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:09.789224 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:10.109387 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:10.110914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:10.118486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:10.119275 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:10.120389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:10.121248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:10.172737 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:10.187686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4db9f35e-b52f-491d-9882-9c3c6bd8ab9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.437606 Jul 20 21:56:10.188286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 213/446] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:09 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:10.402512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:10.410426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-eff6530e-680b-4a8b-8e99-f186d23af75e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.305215 Jul 20 21:56:10.413675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 234/447] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:10 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:10.440216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:10.441840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:10.452108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:10.452933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:10.453993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:10.454815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:10.781634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:10.790910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:10.792576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:10.793815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d277d108-7322-4174-81f4-97696b3ba7b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.361221 Jul 20 21:56:10.799638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 214/448] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:10 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:11.209541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:11.210531 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:11.218126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.218726 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:11.219909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.220578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:11.406990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:11.416977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ef62a99a-860f-42c2-863c-00a85a863c63 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.212096 Jul 20 21:56:11.417878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 235/449] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:11 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:11.432239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:11.433140 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:11.439425 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.439873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:11.440629 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.441665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:11.604683 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:11.613791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b1b6ecd5-96db-428d-ab10-e9e1fbea4580 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.185920 Jul 20 21:56:11.614739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 215/450] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:11 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:11.820030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:11.821089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:11.830105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.830900 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:11.831955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:11.832578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:12.010720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:12.035170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:12.038822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:12.042438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7c3e99ab-d59a-4cbd-acef-93d692d69abd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.227223 Jul 20 21:56:12.044120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 236/451] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:11 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:12.440931 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:12.442180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:12.445036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:12.450927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:12.467478 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:12.468257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:12.469314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:12.470375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:12.633291 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:12.633883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:12.644720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:12.645313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:12.646190 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:12.646868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:12.653614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:12.669481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-01d18623-625b-4e56-817e-598c5a663e54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.231444 Jul 20 21:56:12.670292 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 216/452] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:12 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:12.837040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:12.846686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5e3774ea-ae7d-42b2-ae43-d20b02334558 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.218544 Jul 20 21:56:12.847697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 237/453] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:12 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:13.074477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:13.088498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:13.095747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.096298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.097162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.097676 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.285030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:13.303264 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:13.306585 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:13.309555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1b3b1be1-8141-48e8-a013-fed793b7d6e9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.241892 Jul 20 21:56:13.310487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 217/454] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:13 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:13.688791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:13.689579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:13.708049 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.708815 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.709831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.710497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.791977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:13.867487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:13.869123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:13.876841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.878313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.879365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:13.879868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:13.918857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:13.934650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7fd87e37-430b-4a34-9743-d650e8143d94 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.250885 Jul 20 21:56:13.935272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 238/455] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:13 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:14.100858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:14.115363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-37f426c6-9983-4d8c-845c-1ef1c4e0a468 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.254935 Jul 20 21:56:14.116000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 218/456] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:13 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:14.329985 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:14.330515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:14.339383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:14.340105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:14.341028 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:14.341756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:14.507336 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:14.516121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:14.519387 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:14.520199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-980c0461-9793-49c1-9dc2-cc8b466806ef tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.194338 Jul 20 21:56:14.521103 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 239/457] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:14 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:14.957072 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:14.959226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:14.971003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:14.971559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:14.972525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:14.973188 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:15.135131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:15.136416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:15.156617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:15.165757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:15.166039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d5ec18fd-219b-4aba-b9cc-c83f6d1c16d2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.217605 Jul 20 21:56:15.166193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:15.166992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:15.167458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:15.176383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 219/458] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:14 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:15.432259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:15.442594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c4bf63c0-e045-4001-987c-0729e8a9a643 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.312087 Jul 20 21:56:15.443338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 240/459] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:15 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:15.546337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:15.547834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:15.560274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:15.561693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:15.562675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:15.563275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:16.122951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:16.135895 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:16.137815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:16.139527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-87044e0e-8d57-4cc1-bb33-10b0f35379f6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1743 microversion: 2.20 time: 0.601793 Jul 20 21:56:16.140734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 220/460] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:15 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1743 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:16.185090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:16.185885 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:16.197236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:16.197684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:16.198460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:16.198887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:16.360434 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:16.370189 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6955e4f2-81c3-41f0-8398-83abc2ef22cf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.188930 Jul 20 21:56:16.381378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 241/461] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:16 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:16.466019 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:16.468112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:16.476786 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:16.477249 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:16.478044 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:16.478490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:16.481503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:16.729342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:16.738884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-72285e82-8848-4d9c-bc23-28552a4f8919 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.278712 Jul 20 21:56:16.741214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 221/462] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:16 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:17.160737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:17.161719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:17.170114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.170949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:17.171966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.172604 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:17.378747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:17.387979 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:17.388741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:17.398168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:17.400321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:17.401669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d917702b-3671-4311-82f4-1fff7eb6475f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1743 microversion: 2.20 time: 0.246424 Jul 20 21:56:17.402524 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 242/463] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:17 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:17.409844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.410520 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:17.411380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.411973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:17.736245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:17.761560 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3acebea1-a94c-4dfa-a0a7-e4055ef1d2ff tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.377214 Jul 20 21:56:17.763268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 222/464] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:17 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:17.769933 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:17.770555 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:17.798459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=74 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:17.808898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.809557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:17.810624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:17.811230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.000571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:18.004501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:18.012643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b4af511c-d871-4ffe-9f27-61fbaa3cce6a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.246463 Jul 20 21:56:18.024259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 243/465] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:17 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:18.130517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-9a7dc5f6-7041-4b4d-9071-466cfd6602d2 req-090c83fc-fd57-4ebd-9630-4246c13aaa60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e5c68-07b5-4609-8115-3274fed99407", "name": "network-vif-plugged", "status": "completed", "tag": "bf362a45-0286-49b4-ae07-a2b6365512d4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:18.147909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-9a7dc5f6-7041-4b4d-9071-466cfd6602d2 req-090c83fc-fd57-4ebd-9630-4246c13aaa60 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.149061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-9a7dc5f6-7041-4b4d-9071-466cfd6602d2 req-090c83fc-fd57-4ebd-9630-4246c13aaa60 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.169223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-9a7dc5f6-7041-4b4d-9071-466cfd6602d2 req-090c83fc-fd57-4ebd-9630-4246c13aaa60 service nova] Creating event network-vif-plugged:bf362a45-0286-49b4-ae07-a2b6365512d4 for instance 382e5c68-07b5-4609-8115-3274fed99407 on hv-cinder-84969 Jul 20 21:56:18.178885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-9a7dc5f6-7041-4b4d-9071-466cfd6602d2 req-090c83fc-fd57-4ebd-9630-4246c13aaa60 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056094 Jul 20 21:56:18.180580 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 223/466] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:18.367485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:18.368416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:18.375968 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.376877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.377887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.378538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.427187 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:18.428112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:18.448213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.450734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.451256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8f77a08d-d3e7-4c0f-87eb-fad88cdee63c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/ips" status: 200 len: 150 microversion: 2.1 time: 0.087709 Jul 20 21:56:18.458350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 244/467] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:56:18 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:18.459002 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.486155 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.765436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:18.777649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:18.780243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:18.781605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:18.781919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-02250656-5a61-47fe-8f5d-cf5526b7a7b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1743 microversion: 2.20 time: 0.364087 Jul 20 21:56:18.782866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:18.793814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.795517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 224/468] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:18 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1743 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:18.797294 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.799710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:18.800269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:18.996611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:19.011439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-24a020dd-6107-4ef2-ae27-67dd33926490 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1723 microversion: 2.1 time: 0.234846 Jul 20 21:56:19.011960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 245/469] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:18 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:19.029735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:19.030603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:19.037069 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:19.037526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:19.038364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:19.039124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:19.214033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:19.226697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5c03ca53-ae8f-4c5e-88a0-171d9c4c50ba tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.200672 Jul 20 21:56:19.236828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 225/470] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:19 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:19.802260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:19.802857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:19.813424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:19.814020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:19.814803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:19.815265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:19.977550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:19.988046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:19.989883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:19.991782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-330d6852-ce12-4d5e-b065-50cb3500cb80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.193042 Jul 20 21:56:19.993113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 246/471] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:19 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:20.030822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:20.032515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:20.039876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:20.049209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.049933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.050728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.051195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.106284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67aaadbf-46a0-4aa6-bc3d-6e9f3a676506"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:20.108980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:20.122104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.122484 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.127913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.128368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.293678 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:20.307507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ade58b44-8262-4ed0-a88f-df3b2350c8bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1700 microversion: 2.1 time: 0.281830 Jul 20 21:56:20.308291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 226/472] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:20 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1700 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:20.313537 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-ba20c8fc-446a-4f2b-9c38-cb3cbcba402b req-97eb2a5b-7803-496f-a810-5066d990488e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "name": "network-vif-plugged", "status": "completed", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:20.326929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ba20c8fc-446a-4f2b-9c38-cb3cbcba402b req-97eb2a5b-7803-496f-a810-5066d990488e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.327694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ba20c8fc-446a-4f2b-9c38-cb3cbcba402b req-97eb2a5b-7803-496f-a810-5066d990488e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.345986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-ba20c8fc-446a-4f2b-9c38-cb3cbcba402b req-97eb2a5b-7803-496f-a810-5066d990488e service nova] Creating event network-vif-plugged:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:56:20.353718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-ba20c8fc-446a-4f2b-9c38-cb3cbcba402b req-97eb2a5b-7803-496f-a810-5066d990488e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044048 Jul 20 21:56:20.355044 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 227/473] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:20.361983 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:20.362970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:20.374063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.374783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.375870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.376536 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.682854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9034f7b8-14a7-4071-81c1-10d73b8eb2b4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583896 Jul 20 21:56:20.687542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 247/474] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:56:20 2022] POST /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:20.697738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d8c18447-72ce-43b5-84b3-1f572cc6e884 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:20.707303 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:20.717337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d8c18447-72ce-43b5-84b3-1f572cc6e884 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.720337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d8c18447-72ce-43b5-84b3-1f572cc6e884 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.723779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-03123a99-4bfd-499d-ada1-dfb49cd78404 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1315 microversion: 2.1 time: 0.367339 Jul 20 21:56:20.724609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 228/475] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:20 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:20.751782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d8c18447-72ce-43b5-84b3-1f572cc6e884 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Going to try to start instance {{(pid=124151) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 21:56:20.817438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d8c18447-72ce-43b5-84b3-1f572cc6e884 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action" status: 202 len: 0 microversion: 2.1 time: 0.127872 Jul 20 21:56:20.819332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 248/476] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:56:20 2022] POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:56:20.828490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:20.829312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:20.839435 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.840424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:20.845244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:20.846055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:21.016157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:21.017272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:21.030676 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:21.031539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:21.032697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:21.033516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:21.077521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:21.094451 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-47c85c91-ccdc-493d-b30c-bfca1d6346b0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1709 microversion: 2.1 time: 0.270341 Jul 20 21:56:21.096734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 229/477] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:20 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1709 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:21.336459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:21.351973 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:21.354446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:21.356127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5923e854-5af4-4f9b-8359-66ec19655d1f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.346226 Jul 20 21:56:21.357239 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 249/478] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:21 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:21.756084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:21.757621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:21.766759 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:21.767674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:21.771609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:21.772571 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.115915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:22.117545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:22.136306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.137162 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.138240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.138904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.248750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 21:56:22.249464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 21:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b (ip 10.222.0.86) !!! Jul 20 21:56:22.281353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:22.316901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6f91d70e-0322-4524-aad3-07ce3b477908 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1464 microversion: 2.1 time: 0.567787 Jul 20 21:56:22.319814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 230/479] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:21 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1464 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:22.375589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:22.376505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:22.385772 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.386236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.387027 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.387517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.601296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:22.610859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3fb5dba4-6f69-4c11-8d08-e3baf84c0abf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1709 microversion: 2.1 time: 0.500167 Jul 20 21:56:22.619091 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 250/480] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:22 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1709 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:22.624847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:22.625490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:22.633444 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.633923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.634696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.635187 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.675431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:56:22.706820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:22.722236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:22.724642 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:22.727796 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9d568c71-521e-4238-b390-ace2a562d756 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.356283 Jul 20 21:56:22.745054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 231/481] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:22 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:22.751874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-aa61ca78-6d47-441b-a6fa-9086f18f2444 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'create', calling method: .version_select at 0x7f6aba776940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-369258151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOr5yBc6l5Ac60WPVT8dXKjMlBDa3oQbXeJgx3Ua+ZERmSYHmfMoD/8Rv3SZzncff82UYSMAFF22jqbegi7G0wMRfHvhpMlUMXeGfVcqgvs+GEdn2E8dj8pQHo9Xt6mVWg=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:22.785338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-aa61ca78-6d47-441b-a6fa-9086f18f2444 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Getting quotas for project c17214008914495b8083b74c6fc9e405. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:56:22.796987 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-aa61ca78-6d47-441b-a6fa-9086f18f2444 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Getting quotas for user 030fcf8f4e654d08ac9c7e5dcb3eddd9 and project c17214008914495b8083b74c6fc9e405. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:56:22.829807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-25450137-c7a9-4d60-be0f-cd486d8a070b tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "DELETE /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 204 len: 0 microversion: 2.1 time: 0.208942 Jul 20 21:56:22.830971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 251/482] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:56:22 2022] DELETE /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:56:22.847580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:22.850036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:22.858196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-aa61ca78-6d47-441b-a6fa-9086f18f2444 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.124058 Jul 20 21:56:22.858866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 232/483] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:56:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:22.875255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.878713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.879945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:22.881413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:22.940690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-163914862", "imageRef": "f3ddc76e-68b4-4c8b-9580-f683a491ae56", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-369258151", "networks": [{"uuid": "4179ef90-7982-4b17-9288-af94c2602610"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:23.060129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] validate_networks() for [('4179ef90-7982-4b17-9288-af94c2602610', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:56:23.132378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:23.147114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-712aeb84-ba09-4dba-83b1-98a0f59449b7 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1470 microversion: 2.1 time: 0.309720 Jul 20 21:56:23.148204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 252/484] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:22 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:23.616677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:56:23.617804 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:56:23.618349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:56:23.618873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:56:23.619421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:56:23.643557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:23.644176 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:23.648815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.649874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.651374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.652548 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.653487 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.654131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.655106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.655695 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.682162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Getting quotas for project c17214008914495b8083b74c6fc9e405. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:56:23.690691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Getting quotas for user 030fcf8f4e654d08ac9c7e5dcb3eddd9 and project c17214008914495b8083b74c6fc9e405. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:56:23.704205 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:56:23.707220 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3ddc76e-68b4-4c8b-9580-f683a491ae56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:56:23.782370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-97ba7d28-14e7-45e9-8cae-d3bc485fdd70 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841471 Jul 20 21:56:23.783141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 233/485] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:56:23.788425 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:23.794793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:23.804147 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.804666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.805677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:23.806249 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:23.861893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:23.873164 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ca36978c-4349-4af5-93fd-62bff769090f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1709 microversion: 2.1 time: 0.233443 Jul 20 21:56:23.875233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 253/486] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:23 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:23.895875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ea26ce31-34bf-483d-b629-232d7c486e1c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:23.903953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ea26ce31-34bf-483d-b629-232d7c486e1c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:23.988936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ea26ce31-34bf-483d-b629-232d7c486e1c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:24.007289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ea26ce31-34bf-483d-b629-232d7c486e1c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1257 microversion: 2.1 time: 0.122832 Jul 20 21:56:24.009105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 254/487] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:23 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1257 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:24.080669 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:24.095011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:24.096578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:24.097867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-103b0675-39a7-44e0-b82f-d1a9b49e58a2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.313708 Jul 20 21:56:24.098856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 234/488] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:23 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:24.177318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:24.178625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:24.202353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:24.202976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:24.203858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:24.204670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:24.387658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:24.396618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6653b462-683b-4591-b562-f6e1877b80dc tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1470 microversion: 2.1 time: 0.225167 Jul 20 21:56:24.398286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 255/489] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:24 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:24.892620 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:24.893217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:24.906282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:24.907947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:24.909928 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:24.911569 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.027095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:25.028287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:25.041051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.041629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.042432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.042886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.144181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.152722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bf36cd69-9b4a-4360-99e1-96197e5efd7c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1253 microversion: 2.1 time: 0.131105 Jul 20 21:56:25.153668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 256/490] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:25 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1253 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:25.167672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:25.168668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:25.173376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.184710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.185246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.185561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-695af6f9-ed86-40e2-b1d8-3f18bfe41923 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1709 microversion: 2.1 time: 0.295933 Jul 20 21:56:25.185916 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.186347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.186939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 235/491] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:24 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1709 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:25.373627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.380034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:25.384384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.385953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.387189 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4470e7bb-39ef-4bb2-ab7e-074bc40c6367 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.231601 Jul 20 21:56:25.388024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 257/492] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:25 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:25.416961 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:25.417755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:25.424326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.425195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.426278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:25.426792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:25.610741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:25.618971 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-285b43ac-c4d2-4ae6-8ca9-d5be80596ac6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1470 microversion: 2.1 time: 0.206853 Jul 20 21:56:25.619687 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 236/493] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:25 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:26.171040 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:26.171669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:26.181825 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.182296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.183044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.183584 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.205209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:26.206459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:26.216774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.217584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.218724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.219624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.303304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.315463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-001d7bf9-7687-41d4-97a0-cf95fc55b8e3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1309 microversion: 2.1 time: 0.148565 Jul 20 21:56:26.327259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 258/494] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:26 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:26.406799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:26.407791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:26.421916 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.422662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.424896 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.426903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.489810 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.505186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5a7c273e-b8d8-424e-9efd-a6b23ed4a2d4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1709 microversion: 2.1 time: 0.305073 Jul 20 21:56:26.505983 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 237/495] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:26 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1709 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:26.638071 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:26.638924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:26.640125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.645547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.646296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.647877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:26.649169 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:26.650843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.652679 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.654355 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-52453084-971f-40fd-9b6f-1b701207673b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.252461 Jul 20 21:56:26.655136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 259/496] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:26 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:26.801817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:26.810792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4394be1c-9aa8-4976-b30b-9c5104dd69be tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1470 microversion: 2.1 time: 0.176993 Jul 20 21:56:26.811433 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 238/497] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:26 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:27.335935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:27.335935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:27.359513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.360592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.366382 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.373005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.493681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:27.503000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1ede035f-d611-4105-8cd1-5155c1dc88f5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1327 microversion: 2.1 time: 0.171328 Jul 20 21:56:27.518120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 260/498] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:27 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:27.525615 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:27.527335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:27.536543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.537817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.539352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.540329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.674833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:27.675819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:27.693289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.693739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.694822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.696241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.906461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:27.917150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-49ecfd39-7719-4226-86b3-da1fd060ca9a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1713 microversion: 2.1 time: 0.395981 Jul 20 21:56:27.935328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 239/499] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:27 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1713 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:27.940199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:27.940837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:27.957832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.958101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:27.958892 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:27.959354 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:28.144332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:28.153847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:28.161706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:28.165034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0341e275-a887-4895-bd79-fc764f8a539e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.495266 Jul 20 21:56:28.186869 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 261/500] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:27 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:28.317174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:28.324905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:28.328177 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7423610c-5f48-4350-aa01-2de1347a8b7a tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1470 microversion: 2.1 time: 0.391589 Jul 20 21:56:28.345208 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 240/501] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:27 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:28.525154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:28.526250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:28.542058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:28.542520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:28.543337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:28.543777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:28.697681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:28.711502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c74f2071-c9e8-489c-8464-67be8b9acbb3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1315 microversion: 2.1 time: 0.190644 Jul 20 21:56:28.712642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 262/502] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:28 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:28.737910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-87adc9a6-ee2a-47da-b236-f9ed551e0d40 req-14bbdcc9-0fd2-419e-a8f8-445e1b0deb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e5c68-07b5-4609-8115-3274fed99407", "name": "network-vif-deleted", "tag": "bf362a45-0286-49b4-ae07-a2b6365512d4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:28.764821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-87adc9a6-ee2a-47da-b236-f9ed551e0d40 req-14bbdcc9-0fd2-419e-a8f8-445e1b0deb1b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:28.766710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-87adc9a6-ee2a-47da-b236-f9ed551e0d40 req-14bbdcc9-0fd2-419e-a8f8-445e1b0deb1b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:28.793496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-87adc9a6-ee2a-47da-b236-f9ed551e0d40 req-14bbdcc9-0fd2-419e-a8f8-445e1b0deb1b service nova] Creating event network-vif-deleted:bf362a45-0286-49b4-ae07-a2b6365512d4 for instance 382e5c68-07b5-4609-8115-3274fed99407 on hv-cinder-84969 Jul 20 21:56:28.805731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-87adc9a6-ee2a-47da-b236-f9ed551e0d40 req-14bbdcc9-0fd2-419e-a8f8-445e1b0deb1b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074812 Jul 20 21:56:28.811509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 241/503] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:29.192909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:29.196099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:29.209183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.211098 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.212018 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.212457 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.355587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:29.357059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:29.365547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.366844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.368173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.368771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.432553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:29.446508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:29.453017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:29.457864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c5c3f245-27df-483e-b442-02a674056557 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.275032 Jul 20 21:56:29.467338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:29.481240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 263/504] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:29 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:29.485077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9b4f50cc-1109-4c75-ad55-d45c05d56042 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.136336 Jul 20 21:56:29.488112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 242/505] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:29 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:29.729698 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:29.731868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:29.739569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.740378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.741865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:29.742508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:29.939302 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:29.948102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-dd3bf8c8-6da5-483a-a61a-5bb726e414e5 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.222151 Jul 20 21:56:29.949322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 264/506] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:29 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:30.486137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:30.487211 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:30.496372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.497316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:30.498627 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.509032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:30.510129 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:30.512909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:30.524662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.528024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:30.529073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.529632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:30.653209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:30.670577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ab02ecd1-0087-4cd3-99f7-5f4e0537145e tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.160125 Jul 20 21:56:30.675331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 265/507] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:30 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:30.747332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:30.756793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:30.759405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:30.760803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ef6c5016-1ff1-4171-8969-197918c0ca8e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.283463 Jul 20 21:56:30.772217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 243/508] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:30 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:30.969295 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:30.970607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:30.978636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.979504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:30.980494 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:30.981136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:31.168590 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:31.177728 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fc98252d-2b84-46a8-a1e0-efb8e70f5309 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.213761 Jul 20 21:56:31.178337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 266/509] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:30 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:31.688818 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:31.689775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:31.701432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:31.702001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:31.703256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:31.703938 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:31.779882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:31.780900 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:31.789622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:31.790329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:31.791478 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:31.792113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:31.811831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:31.821412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0d964e0d-cff2-4833-838c-3e2e361a5ce4 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.136590 Jul 20 21:56:31.830611 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 244/510] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:31 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:31.943471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:31.952567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:31.954165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:31.955352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d5039acc-5ae6-41a1-ac6a-ea4f501d1ab5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.179690 Jul 20 21:56:31.955917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 267/511] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:31 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:32.195400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:32.195933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:32.202053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.202444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:32.203235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.203674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:32.340327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:32.347975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-865fdf3a-2cc5-41b9-a9c9-1fd955b619c0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.157115 Jul 20 21:56:32.348543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 245/512] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:32 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:32.839822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:32.840545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:32.847733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.848855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:32.851507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.852119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:32.922318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:32.930619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-77180964-af28-4a9d-9c60-1beec3bfc7b6 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.094703 Jul 20 21:56:32.931221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 268/513] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:32 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:32.973828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:32.974436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:32.981416 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.981853 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:32.982617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:32.983294 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:33.130828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:33.150408 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:33.152045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:33.153237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e67bbc9a-e4a5-4e69-a37a-dc743773c8b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.183375 Jul 20 21:56:33.153798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 246/514] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:32 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:33.366373 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:33.367177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:33.373479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:33.373925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:33.374688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:33.375145 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:33.530672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:33.538274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e395fc9b-275b-4feb-9dcf-53e34d9a19d7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.176408 Jul 20 21:56:33.538853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 269/515] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:33 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:33.948291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:33.948911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:33.952256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:33.953111 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=10 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:33.957866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:33.958601 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:33.959494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:33.959938 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:34.028118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:34.036327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-53bedcef-2f05-4c5c-96ae-9a7e8afcf39f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.092795 Jul 20 21:56:34.036915 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 247/516] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:33 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:34.171504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:34.172049 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:34.174299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:34.180524 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:34.181098 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:34.182055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:34.182583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:34.322526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:34.330479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:34.332077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:34.333219 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1a78472c-1064-4a75-841c-3eec55de9e93 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.165702 Jul 20 21:56:34.333773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 270/517] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:34 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:34.555538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:34.556567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:34.564456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:34.564912 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:34.565694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:34.566133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:34.716709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:34.724717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-df11432e-f32f-4b8b-b329-d8a09ef4e19a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.173726 Jul 20 21:56:34.725459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 248/518] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:34 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:35.056621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:35.057233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:35.063572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.064027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.064797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.065234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.135230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:35.143361 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be09e70c-6b83-47ed-8b4c-66b73e4684eb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.091008 Jul 20 21:56:35.144137 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 271/519] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:35 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:35.352563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:35.353221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:35.359775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.360225 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.360991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.361426 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.503655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:35.512936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:35.514486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:35.515735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-da2711d5-a6cd-4ee8-8d93-0046221136e4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.167541 Jul 20 21:56:35.516298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 249/520] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:35 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:35.742337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:35.743128 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:35.750644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.751253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.752042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:35.752480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:35.890875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:35.900022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-df9f2e4e-e780-4187-bbce-344a57093e15 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.161937 Jul 20 21:56:35.903948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 272/521] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:35 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:36.161079 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:36.161596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:36.167705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.168157 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.168912 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.169348 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.244590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:36.260606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-391f0bd0-e6dc-4522-b363-b057cece7e21 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.102658 Jul 20 21:56:36.261841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 250/522] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:36 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:36.534196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:36.535015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:36.541683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.542214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.543081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.543596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.917972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:36.918692 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:36.925245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.926015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.926872 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:36.927404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:36.956264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:36.965770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:36.967308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:36.968457 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-00b89685-90d5-4c93-82f6-13adb2d763ab tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.438413 Jul 20 21:56:36.969035 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 273/523] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:36 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:37.081925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:37.093118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4f12b8d0-5398-4d18-94a8-29941e77bbd8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.179955 Jul 20 21:56:37.094216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 251/524] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:36 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:37.286746 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:37.287382 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:37.294359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:37.294828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:37.295838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:37.296304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:37.323247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:37.383499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:37.391623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7307c5ec-b069-4451-b770-52e14177a76c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.116824 Jul 20 21:56:37.392200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 274/525] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:37 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:37.987232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:37.988028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:37.994833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:37.995313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:37.996538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:37.996969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:38.112824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:38.113437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:38.124461 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:38.124904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:38.125665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:38.126094 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:38.140472 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:38.167144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:38.168735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:38.169932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-12982e33-6ea8-4df3-b758-ad3beb423b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.186593 Jul 20 21:56:38.182160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 252/526] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:37 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:38.317149 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:38.325719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a2834a89-f5e9-4a5b-8020-dcd557953dff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.216685 Jul 20 21:56:38.326622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 275/527] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:38 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:38.409700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:38.410358 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:38.420306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:38.421302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:38.422778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:38.423694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:38.502760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:38.519328 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-08916796-92af-4111-88a3-18dd7ed29e53 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.113574 Jul 20 21:56:38.533700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 253/528] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:38 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:39.189389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:39.189992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:39.197163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.197634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.198442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.198938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.344003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:39.344688 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:39.351816 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.352277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.353061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.353499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.353705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:39.362582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:39.364135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:39.365304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3d0b5eea-b6d3-4f8b-a993-c5700884261e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.180002 Jul 20 21:56:39.376929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 276/529] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:39 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:39.500175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:39.508498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-655730fa-315a-4997-a3ca-a7d3142b1ca7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.168684 Jul 20 21:56:39.509060 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 254/530] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:39 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:39.542210 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:39.543102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:39.549414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.549864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.550634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:39.551080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:39.619716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:39.629059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c375a0d0-a233-49dd-b366-afa17a3b5c6d tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.091378 Jul 20 21:56:39.629923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 277/531] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:39 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:40.400119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:40.400845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:40.409535 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.410236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.411388 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.411992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.525299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:40.525934 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:40.532566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.533016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.533789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.534214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.553830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:40.562258 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:40.563824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:40.564990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-14676d96-3f72-4fcc-8a30-2bd2d1e1e7dc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.170669 Jul 20 21:56:40.565917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 255/532] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:40 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:40.647876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:40.648488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:40.654698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.655106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.655882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:40.656342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:40.681310 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:40.691163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cf8adb0b-04c2-42ba-9e75-ec5d2e3dbee1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.170432 Jul 20 21:56:40.700926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 278/533] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:40 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:40.734597 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:40.742460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8b337e7d-a81f-4860-b6fe-968537e664a9 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.099153 Jul 20 21:56:40.743037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 256/534] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:40 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:41.584022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:41.585280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:41.592870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.593105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.593875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.594327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.709074 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:41.710322 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:41.717462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.718014 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.718909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.719453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.737635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:41.747621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:41.748756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:41.750399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-403b9991-9934-49f4-a09f-18d13996a3a8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.169548 Jul 20 21:56:41.766043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 279/535] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:41 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:41.770862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:41.771531 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:41.778566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.779165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.779863 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:41.782632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:41.866388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:41.886791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e231f736-2cef-4c24-9992-180582a8c6cb tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.119827 Jul 20 21:56:41.888148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 280/536] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:41 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:41.898594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:41.914693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3c9bd35f-932d-4165-8ecf-9d8cf46ea841 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.207667 Jul 20 21:56:41.914693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 257/537] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:41 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:42.769260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:42.769888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:42.776666 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.777122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.777880 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.778317 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.904142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:42.904761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:42.909801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:42.911552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.912005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.913341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.913782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.917952 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:42.918653 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:42.920351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:42.921490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-edb50dca-a0fd-47d9-b5a7-415efdcb08d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.156206 Jul 20 21:56:42.922252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 281/538] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:42 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:42.930356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:42.931364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:42.938237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.938751 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.939710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:42.940211 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:42.989594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:42.999424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3c8d5921-9f7d-43b2-9794-9f512d717223 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1428 microversion: 2.1 time: 0.099013 Jul 20 21:56:43.000015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 258/539] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:42 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:43.092091 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:43.099617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-94229872-599b-41f6-8da7-e0af02488aaf tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.173903 Jul 20 21:56:43.100774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 282/540] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:42 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:43.941376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:43.942025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:43.949480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:43.949934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:43.950706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:43.951173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.018363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:44.019199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:44.026381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.026832 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.027700 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.028140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.061158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.061609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.062081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lazy-loading 'fault' on Instance uuid 382e5c68-07b5-4609-8115-3274fed99407 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:56:44.150601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:44.158171 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e7be23a8-e01f-4ea1-b1c9-41fe0d34095c tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1305 microversion: 2.1 time: 0.144612 Jul 20 21:56:44.158727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 283/541] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:44 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:44.163801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:44.164083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:44.171550 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.172073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.172768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.173278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.194557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:44.204256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:44.204893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:44.206066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-09df3078-7d39-46d1-be49-e478d9cef487 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1738 microversion: 2.20 time: 0.269111 Jul 20 21:56:44.206634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 259/542] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:43 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:44.452668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:44.469780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-494e4c52-6e68-45b9-bac8-3e9b3da785a7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.309044 Jul 20 21:56:44.471120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 284/543] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:44 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:44.597750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-afa2558c-5774-470a-bb3d-2c6ef3d14896 req-1610424f-fa12-47bc-9934-ca415b999a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:44.608277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-afa2558c-5774-470a-bb3d-2c6ef3d14896 req-1610424f-fa12-47bc-9934-ca415b999a60 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:44.608771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-afa2558c-5774-470a-bb3d-2c6ef3d14896 req-1610424f-fa12-47bc-9934-ca415b999a60 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:44.621634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-afa2558c-5774-470a-bb3d-2c6ef3d14896 req-1610424f-fa12-47bc-9934-ca415b999a60 service nova] Creating event network-changed:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 21:56:44.637400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-afa2558c-5774-470a-bb3d-2c6ef3d14896 req-1610424f-fa12-47bc-9934-ca415b999a60 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043824 Jul 20 21:56:44.638138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 260/544] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:56:44.671864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f9b524b5-3419-4b3c-9bf6-7d1199399be9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: .version_select at 0x7f6aba805550>, body: {"keypair": {"name": "tempest-keypair-490405374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7FOD63V4/Zm96rChgXW+HDCv2vGBZ0zn1U3NCHEr/fkXEvWIcA8kQscxcYvTU3m1rhuvHNAMVzbEju1QsgDzFyOZmpG/22CEb/zAiJkdCAO8TsiIwQWCtYcyncShuXJQ=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:44.687168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-f9b524b5-3419-4b3c-9bf6-7d1199399be9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:56:44.691436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-f9b524b5-3419-4b3c-9bf6-7d1199399be9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:56:44.694837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:44.722468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f9b524b5-3419-4b3c-9bf6-7d1199399be9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054375 Jul 20 21:56:44.723260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 285/545] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:56:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:45.177238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:45.178131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:45.184520 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.185085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.185925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.186371 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.218873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.219359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.219818 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lazy-loading 'fault' on Instance uuid 382e5c68-07b5-4609-8115-3274fed99407 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:56:45.226186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:45.226740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:45.233004 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.233729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.234510 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.234977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.264400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b96b7a3a2142528dd94d5eaf8de9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4eb21113d83407db43d77aafcb5a33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:45.273407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1e903e9f-153e-4a7f-bd7d-7d4eb6ac297f tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 200 len: 1305 microversion: 2.1 time: 0.100919 Jul 20 21:56:45.274229 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 261/546] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:45 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:45.398446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:45.407533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:45.409119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:45.410414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-add5ef21-e749-4f1d-9941-f2798642bbaf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1720 microversion: 2.20 time: 0.189192 Jul 20 21:56:45.411144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 286/547] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:45 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:45.494146 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:45.494913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:45.499852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:45.507287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.508118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.508925 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:45.509385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:45.872025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:45.883533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-adbee5da-6bfa-4951-a813-62e9961c8b69 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.394697 Jul 20 21:56:45.884563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 262/548] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:45 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:46.294140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:46.294909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] [instance: 382e5c68-07b5-4609-8115-3274fed99407] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:46.301558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.302011 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:46.302772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.303784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:46.317865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] HTTP exception thrown: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Request method failure captured: Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 HTTP/1.1 Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hnv0WwGSR4KwCZBTzfp774irkR7CuDmCbA5kbl9V1PiuJEB1764JFXQp1xo2Byogg1VovDTih9ZvZGT2K2jcjaD-LAs0TjRug1vctxYMZgLjbjGN06mQlPoMXnrX82hTHdMZ3VSz_QQ4fKgWVJkpwZIKnkH7QRWQY_joia-aMhW3ig Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: b4eb21113d83407db43d77aafcb5a33c Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-141146872 Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:56:46.319966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b4eb21113d83407db43d77aafcb5a33c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b4eb21113d83407db43d77aafcb5a33c", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b4eb21113d83407db43d77aafcb5a33c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b4eb21113d83407db43d77aafcb5a33c"}]}] Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-141146872 Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: b4eb21113d83407db43d77aafcb5a33c Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-141146872 Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-141146872-project Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c9b96b7a3a2142528dd94d5eaf8de9aa Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-141146872-project Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. Jul 20 21:56:46.321737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '382e5c68-07b5-4609-8115-3274fed99407'} Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:56:46.323185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. Jul 20 21:56:46.326388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:56:46.329147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] Returning 404 to user: Instance 382e5c68-07b5-4609-8115-3274fed99407 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:56:46.329147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-604cf84f-abf0-4053-85e3-646fab9fabe0 tempest-VolumesNegativeTest-141146872 tempest-VolumesNegativeTest-141146872-project] 10.222.0.86 "GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407" status: 404 len: 111 microversion: 2.1 time: 0.034628 Jul 20 21:56:46.329147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 287/549] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:46 2022] GET /compute/v2.1/servers/382e5c68-07b5-4609-8115-3274fed99407 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:56:46.342522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2092226665", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e24c0e-fc60-4c54-b80d-8c328d2228f9"}], "security_groups": [{"name": "tempest-securitygroup--1025756752"}], "key_name": "tempest-keypair-490405374", "user_data": "}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:46.432280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:46.433175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:46.440860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.441383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:46.442221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.442655 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:46.606463 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] validate_networks() for [('54e24c0e-fc60-4c54-b80d-8c328d2228f9', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:56:46.800313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:46.812504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:46.814061 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:46.815289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-eb7d6f3d-2f72-4588-8e49-5f1860a33ffb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1720 microversion: 2.20 time: 0.389799 Jul 20 21:56:46.816328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 288/550] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:46 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:46.901367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:46.902086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:46.908911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.909618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:46.911003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:46.911655 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:47.141375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:47.151196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b86641f7-a48f-47d9-b20a-13f8ec7a25d3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.253802 Jul 20 21:56:47.151586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 289/551] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:46 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:47.217449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:56:47.217927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:56:47.218362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:56:47.218723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:56:47.219289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:56:47.229223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:47.229803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:47.230773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:47.231235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:47.250401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:56:47.254387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:56:47.266554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:56:47.268998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:56:47.321024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-24c7ee3c-9c83-4ccd-9375-285cbd844191 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.985373 Jul 20 21:56:47.322419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 263/552] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:56:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:56:47.335434 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-86a53cdc-fc28-408e-9287-48cc38d6e11e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:47.336918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-86a53cdc-fc28-408e-9287-48cc38d6e11e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:47.403901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-86a53cdc-fc28-408e-9287-48cc38d6e11e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:47.412409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-86a53cdc-fc28-408e-9287-48cc38d6e11e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1241 microversion: 2.1 time: 0.083498 Jul 20 21:56:47.413001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 290/553] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:47 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:47.836410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:47.836874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:47.843185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:47.843637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:47.844392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:47.844824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:47.990310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:48.005915 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:48.008109 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:48.008637 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f9c4a75a-5d5f-421d-8f0c-0ecbf8894e98 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1720 microversion: 2.20 time: 0.177791 Jul 20 21:56:48.009192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 264/554] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:47 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:48.169763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:48.170432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:48.177163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:48.178205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:48.180346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:48.180804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:48.315674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:48.323455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-69c19930-bb71-4c15-89b2-674a7a339173 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.157717 Jul 20 21:56:48.324264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 291/555] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:48 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:48.429614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:48.430166 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:48.436276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:48.436727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:48.437525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:48.437964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:48.503088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:48.507266 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fb3c8288-42c2-4041-ae68-bc592aed9a3b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1245 microversion: 2.1 time: 0.081537 Jul 20 21:56:48.507862 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 265/556] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:48 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:49.027412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:49.028179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:49.038151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.038664 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.039486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.040117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.252571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:49.261385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:49.262905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:49.264088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fa4dc370-6acd-47b5-885d-42fd5c6629bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1720 microversion: 2.20 time: 0.240881 Jul 20 21:56:49.264642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 292/557] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:49 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:49.342998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:49.344368 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:49.351708 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.352632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.353652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.354312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.500038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:49.507756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1b68357d-b5bc-4a7f-82c8-d9a57bc93e93 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.170188 Jul 20 21:56:49.508315 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 266/558] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:49 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:49.526308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:49.526912 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:49.532950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.533401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.534181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.534610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.554625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:49.599383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:49.607486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2ea28e0a-e786-422a-b78c-be41cc30a907 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1293 microversion: 2.1 time: 0.085742 Jul 20 21:56:49.608056 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 293/559] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:49 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:49.760222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-91ca30ea-bcff-499b-872f-93b6fcfc7f8a req-6e3c27c9-0b4f-4c20-bd91-a6a93d264c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "name": "network-vif-unplugged", "status": "completed", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:49.770440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-91ca30ea-bcff-499b-872f-93b6fcfc7f8a req-6e3c27c9-0b4f-4c20-bd91-a6a93d264c17 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:49.771010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-91ca30ea-bcff-499b-872f-93b6fcfc7f8a req-6e3c27c9-0b4f-4c20-bd91-a6a93d264c17 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:49.784662 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-91ca30ea-bcff-499b-872f-93b6fcfc7f8a req-6e3c27c9-0b4f-4c20-bd91-a6a93d264c17 service nova] Creating event network-vif-unplugged:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:56:49.790289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-91ca30ea-bcff-499b-872f-93b6fcfc7f8a req-6e3c27c9-0b4f-4c20-bd91-a6a93d264c17 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034146 Jul 20 21:56:49.790883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 267/560] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:50.281767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:50.282393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:50.289251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.289703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.290502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.290917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.424659 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:50.434865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:50.436533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:50.437690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9b08cf4f-32e4-4a22-9255-2c1e79a0ea08 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1723 microversion: 2.20 time: 0.159924 Jul 20 21:56:50.438547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 294/561] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:50 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:50.458277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50aff643-cffd-4f06-a6d8-8b597bd5b392"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:50.460594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:50.467342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.467803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.468577 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.469016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.526313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:50.526935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:50.533425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.533952 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.534953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.535412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.687140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:50.703957 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e2d2e11c-014a-47cf-9677-7b228c0f1f1a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.182447 Jul 20 21:56:50.704561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 295/562] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:50 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:50.709275 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:50.709886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:50.722444 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.723111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.723976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.724475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.838103 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f0c82539-bfc5-4ee7-9fce-2d8def3c0f66 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.384588 Jul 20 21:56:50.838866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 268/563] 10.222.0.86 () {62 vars in 1363 bytes} [Wed Jul 20 21:56:50 2022] POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments => generated 188 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:56:50.847038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:50.858591 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-31f07e8b-c10a-4e9a-8163-7078a58203e3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1293 microversion: 2.1 time: 0.152864 Jul 20 21:56:50.859172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 296/564] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:50 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:50.978325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:50.978896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:50.985999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.986455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:50.987271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:50.987724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.091823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-67a4dcdb-d572-4a37-aff6-efdee11eeef1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/action" status: 202 len: 0 microversion: 2.20 time: 0.118095 Jul 20 21:56:51.092658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 269/565] 10.222.0.86 () {62 vars in 1318 bytes} [Wed Jul 20 21:56:50 2022] POST /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:56:51.101368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:51.102503 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:51.108714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.109117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.109905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.110324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.252760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:51.262119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:51.263788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:51.264953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2bc033d1-fc8a-4bd6-b2ea-6108e07088b0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1809 microversion: 2.20 time: 0.168197 Jul 20 21:56:51.265508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 297/566] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:51 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:51.722386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:51.723192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:51.733505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.734237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.735466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.736141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.881782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:51.883541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:51.892335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.893020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:51.893867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:51.894603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:52.161010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:52.170799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0e264198-7d25-4472-bff5-1c93c8e3be4f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1299 microversion: 2.1 time: 0.296865 Jul 20 21:56:52.171411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 298/567] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:51 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:52.283825 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:52.284741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:52.291842 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:52.292616 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:52.293576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:52.294197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:52.407527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:52.416336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a2376a83-3802-40af-b4fe-03de5368f32d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.698933 Jul 20 21:56:52.417598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 270/568] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:51 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:52.636999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:52.645243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:52.646745 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:52.648289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-45884e5f-54b4-4794-b57e-f7fefb3becb5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1749 microversion: 2.20 time: 0.368253 Jul 20 21:56:52.649002 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 299/569] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:52 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1749 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:56:53.189842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:53.190471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:53.200179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.200919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.201740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.202336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.284054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:53.295147 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b54facf1-3aca-4444-ade2-b281c45675c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1299 microversion: 2.1 time: 0.109734 Jul 20 21:56:53.296036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 271/570] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:53 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:53.433479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:53.434101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:53.442016 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.442875 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.444274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.444946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.605092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:53.613515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8f33cdd1-e97a-419c-9675-97f26cb9f136 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.183865 Jul 20 21:56:53.614136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 300/571] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:53 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:53.676446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:53.679359 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:53.687265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.687265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.687265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:53.687633 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:53.990418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:53.995232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:54.008249 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:54.009777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:54.011321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e32bd8f5-51b1-41ce-a38e-7a48098f76df tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.344621 Jul 20 21:56:54.023467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 272/572] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:53 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:54.316373 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:54.316999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:54.324570 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:54.325022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:54.325784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:54.326217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:54.583200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:54.592024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-733d530a-c8cb-4647-9973-73967969a8be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.280267 Jul 20 21:56:54.593391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 301/573] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:54 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:54.633793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:54.634654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:54.642603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:54.643406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:54.644262 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:54.644766 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:54.957643 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:54.965914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-755648ed-0ea9-49b7-adaa-516d08dc0e42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.338394 Jul 20 21:56:54.966756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 273/574] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:54 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:54.984156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-28ed1674-b481-4618-8490-3db14629709f req-4c546722-b3f8-41b5-80ab-291d2ed63656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9", "tag": "a5f53cca-80b8-4956-8307-f129ce9f38f0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:54.996975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-28ed1674-b481-4618-8490-3db14629709f req-4c546722-b3f8-41b5-80ab-291d2ed63656 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:54.997470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-28ed1674-b481-4618-8490-3db14629709f req-4c546722-b3f8-41b5-80ab-291d2ed63656 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.010741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-28ed1674-b481-4618-8490-3db14629709f req-4c546722-b3f8-41b5-80ab-291d2ed63656 service nova] Creating event network-changed:a5f53cca-80b8-4956-8307-f129ce9f38f0 for instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 on hv-cinder-84969 Jul 20 21:56:55.015914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-28ed1674-b481-4618-8490-3db14629709f req-4c546722-b3f8-41b5-80ab-291d2ed63656 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036837 Jul 20 21:56:55.016512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 302/575] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:56:55.031116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:55.032036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:55.041492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.042131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.043453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.044120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.370116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:55.379004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:55.380431 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:55.382255 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b0f8623d-27b9-4a9b-90b7-3f1a81f22368 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.356096 Jul 20 21:56:55.382840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 274/576] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:55 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:55.610901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:55.611708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:55.619042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.619437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.620238 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.620691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.832836 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:55.844096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5e4ec44e-2742-4594-a63b-0a7f6fccbfb7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.237166 Jul 20 21:56:55.854993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 303/577] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:55 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:55.902020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-ea4e4640-b97c-45c5-9c62-0b170db708ae req-e5a0cccf-5630-42e1-a587-09ec3f24dc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "name": "network-vif-plugged", "status": "completed", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:56:55.911579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ea4e4640-b97c-45c5-9c62-0b170db708ae req-e5a0cccf-5630-42e1-a587-09ec3f24dc76 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.912230 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ea4e4640-b97c-45c5-9c62-0b170db708ae req-e5a0cccf-5630-42e1-a587-09ec3f24dc76 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.926015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-ea4e4640-b97c-45c5-9c62-0b170db708ae req-e5a0cccf-5630-42e1-a587-09ec3f24dc76 service nova] Creating event network-vif-plugged:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 21:56:55.930942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-ea4e4640-b97c-45c5-9c62-0b170db708ae req-e5a0cccf-5630-42e1-a587-09ec3f24dc76 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033047 Jul 20 21:56:55.931999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 275/578] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:56:55.984729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:55.985376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:55.993639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.993966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:55.994749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:55.995287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:56.150125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:56.157628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-77dd4d6c-bc60-47c5-93a1-dd72bfedc3c6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.179373 Jul 20 21:56:56.158193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 304/579] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:55 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:56.401878 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:56.402478 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:56.409627 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:56.410108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:56.410878 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:56.411355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:56.555953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:56.564326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:56.565826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:56.566975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-013b2f54-5dee-470c-a7c8-0886913413e0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.170111 Jul 20 21:56:56.567566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 276/580] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:56 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:56.861672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:56.862282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:56.869621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:56.870104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:56.871819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:56.872823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:57.010703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:57.018139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-72ee43a2-399f-4804-bb60-a3b4e3a89047 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.160394 Jul 20 21:56:57.018895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 305/581] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:56 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:57.175390 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:57.176613 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:57.183556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:57.184395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:57.186047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:57.186789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:57.240023 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:57.261286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:57.341069 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:57.348934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d67d96a1-468a-4ec7-8c4f-2638d5195549 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.177610 Jul 20 21:56:57.356198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 277/582] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:57 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:57.586385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:57.587530 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:57.590154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:56:57.596415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:57.596860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:57.597639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:57.598221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:57.758477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:57.767717 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:57.769228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:57.770381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-59804a0b-736c-443c-beda-5526d1a830fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.188586 Jul 20 21:56:57.770939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 306/583] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:57 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:58.036349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:58.038064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:58.046437 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.047436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.048241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.048750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.196543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:58.207091 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-16682865-834a-44f2-b221-f2e0ac0855d0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.174883 Jul 20 21:56:58.208221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 278/584] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:58 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:56:58.368177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:58.368920 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:58.376529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.377034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.377805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.378371 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.521377 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:58.530134 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6e9b2538-2243-40d7-bb0a-8e1bce4d379c tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.166994 Jul 20 21:56:58.530705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 307/585] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:58 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:58.792524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:58.793190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:58.799819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.800274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.801036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:58.801465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:58.944225 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:58.953186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:58.954673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:58.955849 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ee322421-f1d8-48c2-9e3e-e7ffecb3f888 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.169972 Jul 20 21:56:58.956411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 279/586] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:58 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:56:59.227948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:59.228935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:59.235492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.235937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:59.236703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.237135 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:59.386736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:59.396376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5abfeedd-7de1-4f44-accb-906a21ae62cd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.173867 Jul 20 21:56:59.397138 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 308/587] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:59 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:59.547801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:59.548553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:59.555618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.556077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:59.556866 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.557305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:59.697534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:56:59.705461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-20799364-7a2d-4eac-9ac2-07ce15860f94 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.161468 Jul 20 21:56:59.716494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 280/588] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:56:59 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:56:59.974636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:56:59.975871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:56:59.995206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.995654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:56:59.996718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:56:59.997159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:00.145045 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:00.154121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:00.155736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:00.156820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5b949ddc-378a-4fc5-8df5-bcf0417a6256 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.186177 Jul 20 21:57:00.157384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 309/589] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:56:59 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:00.415417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:00.416278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:00.424369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:00.424883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:00.425825 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:00.426265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:00.584351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:00.593756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2116785d-a816-497f-8cb9-7da2cbbdbeca tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.183146 Jul 20 21:57:00.603033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 281/590] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:00 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:00.723469 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:00.724195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:00.731644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:00.732099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:00.732873 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:00.733306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:00.876535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:00.880012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:00.885284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8cdbc7bd-6de5-4988-8588-a91f53f45987 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.165663 Jul 20 21:57:00.885853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 310/591] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:00 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:01.176952 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:01.177701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:01.185933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.186433 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.188144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.188144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.344702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:01.354729 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:01.356690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:01.358066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-26837cd1-9c7f-43c5-81f7-e87255c1c5bd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.186178 Jul 20 21:57:01.361070 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 282/592] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:01 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:01.610514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:01.611042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:01.617337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.617793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.618575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.619007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.777458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:01.786029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5db0eeea-a4b5-400d-a125-3685f5e56abc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.179733 Jul 20 21:57:01.789050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 311/593] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:01 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:01.901907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:01.902519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:01.910125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-ca40d8ac-c97f-43af-86db-7ca2ca557a65 req-88d75476-d0f3-43cc-9577-bbab503050be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9", "name": "network-vif-plugged", "status": "completed", "tag": "a5f53cca-80b8-4956-8307-f129ce9f38f0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:01.919684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-ca40d8ac-c97f-43af-86db-7ca2ca557a65 req-88d75476-d0f3-43cc-9577-bbab503050be service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.920151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-ca40d8ac-c97f-43af-86db-7ca2ca557a65 req-88d75476-d0f3-43cc-9577-bbab503050be service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.921137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.925226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.926413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:01.929300 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:01.934422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-ca40d8ac-c97f-43af-86db-7ca2ca557a65 req-88d75476-d0f3-43cc-9577-bbab503050be service nova] Creating event network-vif-plugged:a5f53cca-80b8-4956-8307-f129ce9f38f0 for instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 on hv-cinder-84969 Jul 20 21:57:01.939808 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-ca40d8ac-c97f-43af-86db-7ca2ca557a65 req-88d75476-d0f3-43cc-9577-bbab503050be service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Jul 20 21:57:01.940886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 312/594] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:02.122097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:02.130138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-072bd7d5-7f42-4ace-b685-f22fd887e3e7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.232103 Jul 20 21:57:02.131462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 283/595] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:01 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:02.379518 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:02.380211 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:02.387549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:02.388070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:02.388922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:02.389428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:02.533392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:02.542546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:02.544113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:02.545290 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-df43139d-a20b-452e-88ed-4c34a859f7d3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.170764 Jul 20 21:57:02.545843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 313/596] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:02 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:02.806448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:02.807075 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:02.813096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:02.813539 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:02.814286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:02.814714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:02.948644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:02.956485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3be21490-c128-4ecf-aa22-dee82b4951a3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.154014 Jul 20 21:57:02.957104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 284/597] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:02 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:03.152740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:03.152740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:03.156833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.157274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:03.158069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.158499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:03.566974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:03.567657 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:03.576381 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.577543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:03.578554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.579004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:03.587640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:03.596100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9e6c9369-ca99-41f8-83d0-431ee222c6f7 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.451993 Jul 20 21:57:03.597158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 314/598] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:03 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:03.725052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:03.734534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:03.736084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:03.737261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c3d71db4-9570-404a-85f1-d00e6459ff27 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.174301 Jul 20 21:57:03.738037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 285/599] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:03 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:03.978928 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:03.980186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:03.986781 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.987260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:03.988089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:03.988460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:04.154393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:04.169786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-918cba00-2291-47b7-b309-e6f6331c017d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.197982 Jul 20 21:57:04.170763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 315/600] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:03 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:04.613643 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:04.614295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:04.621081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:04.621864 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:04.622672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:04.623138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:04.758106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:04.758710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:04.765353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:04.765798 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:04.766667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:04.767225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:04.770910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:04.782778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-17ba3aec-fe12-4f1c-8a71-b382c1c2c712 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.173202 Jul 20 21:57:04.795088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 286/601] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:04 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:04.920801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:04.930329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:04.931868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:04.933022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4f9bd47b-c09e-4d42-af2f-a9bba3fb5ee6 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.179815 Jul 20 21:57:04.933584 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 316/602] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:04 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:05.187779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:05.188699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:05.195299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.195832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.196616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.197055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.350945 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:05.360852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8bcf788b-38dc-4b2c-9b80-8bf4161bc60d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.176893 Jul 20 21:57:05.361736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 287/603] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:05 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:05.806365 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:05.807552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:05.814822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.815305 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.816084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.816516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.965933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:05.966665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:05.973019 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.973468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.974244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:05.974890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:05.983365 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:05.991078 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a7ee01e8-ac9d-4447-b2c5-3afd7fd13bd6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.188834 Jul 20 21:57:05.992058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 317/604] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:05 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:06.132733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:06.141137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:06.142648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:06.144747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d67305b3-a7ab-4b51-bd73-7c728791880e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.193318 Jul 20 21:57:06.144747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 288/605] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:05 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:06.380746 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:06.382192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:06.388723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:06.389173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:06.389970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:06.390369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:06.532085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:06.539609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5ea1d4f6-7332-459f-bce4-a3a6a7b13285 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.163263 Jul 20 21:57:06.540172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 318/606] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:06 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:07.008224 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:07.008937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:07.015446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.015973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.016775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.017193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.161459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:07.163865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:07.164487 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:07.171190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b0a6f481-d87e-4de2-b475-655316fa5fc6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.166894 Jul 20 21:57:07.172282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.173096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.174106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.174754 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.179779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 289/607] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:07 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:07.337357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:07.352935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:07.354898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:07.356495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d5add5ba-b01a-4a7e-9f16-cf0a0341e529 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.197562 Jul 20 21:57:07.361084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 319/608] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:07 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:07.561509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:07.562192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:07.569723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.569954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.570745 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:07.578171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:07.581337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:07.721803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:07.730154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0e6ee619-cd3b-468d-9771-cb0691ba4a87 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.172540 Jul 20 21:57:07.730755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 290/609] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:07 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:08.189075 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:08.190351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:08.197505 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.197958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.198733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.199198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.358618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:08.368561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ad16b276-f28e-41ef-8b55-551c1b869935 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.183327 Jul 20 21:57:08.370681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 320/610] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:08 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:08.375700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:08.377024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:08.384376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.384833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.385590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.386023 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.552085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:08.560848 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:08.562369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:08.563549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ccca0249-2f1a-422e-b8d8-965e4d0b2fc2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.191985 Jul 20 21:57:08.564118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 291/611] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:08 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:08.747866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:08.748609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:08.756150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.756597 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.757439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:08.759552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:08.910177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:08.918113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-21978ee2-86f2-4e6c-87be-c7556d14034e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.174533 Jul 20 21:57:08.918691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 321/612] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:08 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:09.388050 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:09.388618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:09.395144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.395586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:09.396378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.396813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:09.529344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:09.536750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7719c7d1-9ab5-41de-817d-9a3687f634e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.152611 Jul 20 21:57:09.537617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 292/613] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:09 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:09.581956 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:09.582598 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:09.589500 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.589951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:09.590711 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.591180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:09.771054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:09.779774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:09.781328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:09.782464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fce6b4e9-9bd4-4368-82dd-3552ddc98e38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.204402 Jul 20 21:57:09.783010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 322/614] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:09 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:09.941448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:09.942025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:09.948697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.949136 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:09.949937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:09.950389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:10.084733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:10.092942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6146aa86-176e-4c1a-8f15-00289f740328 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.155530 Jul 20 21:57:10.093436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 293/615] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:09 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:10.554111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:10.555042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:10.561064 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:10.561516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:10.562282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:10.562780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:10.801531 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:10.802117 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:10.809144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:10.809590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:10.810354 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:10.810788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:10.922867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:10.930844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-52ab8b3f-70e6-40da-afd8-e7528db84175 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.380719 Jul 20 21:57:10.931854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 323/616] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:10 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:11.015289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:11.024110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:11.025626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:11.026821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-edc8d095-3509-4086-aebe-f0c84a88a18a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.229165 Jul 20 21:57:11.027440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 294/617] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:10 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:11.110453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:11.111089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:11.117732 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:11.118182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:11.118939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:11.119416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:11.255370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:11.264613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-36aab596-8b67-4adb-a9dc-fc83fadcdff7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.158075 Jul 20 21:57:11.265395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 324/618] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:11 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:11.949403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:11.949954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:11.956438 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:11.956883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:11.957632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:11.958060 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.045279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:12.046080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:12.055770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.056508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.058906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.059585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.102355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:12.110214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-49fcb8ec-2c04-4bc3-8a90-63d8b2a49fcd tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.165838 Jul 20 21:57:12.110789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 295/619] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:11 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:12.118238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66c3b0ec-4fe2-4833-89ed-87dd84f6ae12"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:12.119762 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:12.127110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.127533 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.128309 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.128742 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.252343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:12.261003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:12.262503 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:12.263677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-351b2b67-3cbd-403b-9c67-a7ba8bbb4a69 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.222400 Jul 20 21:57:12.264344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 325/620] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:12 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:12.281265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:12.281887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:12.288046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.289295 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.290191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:12.290617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:12.427205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:12.434740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-37a85158-03bd-490e-8d32-cc2438a6be10 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.156996 Jul 20 21:57:12.435340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 326/621] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:12 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:13.128477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:13.129106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:13.136342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.136800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.137689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.137999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.344756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:13.352185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4d6cc191-6dd5-4d9c-af47-e605aab2b7f3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1357 microversion: 2.1 time: 0.227586 Jul 20 21:57:13.352757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 327/622] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:13 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:13.357324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:13.357925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:13.363722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.364168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.364943 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.365357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.369889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:13.508574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:13.521971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:13.524485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:13.525646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7123e5d5-3e6e-47b2-b0e2-91dcd870cceb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.171975 Jul 20 21:57:13.526416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 328/623] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:13 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:13.530611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:13.531566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:13.537878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.539213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.540068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:13.540532 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:13.673087 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:13.680851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-86ff0671-93e6-456e-b67b-eb80be5c5878 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1367 microversion: 2.1 time: 0.153630 Jul 20 21:57:13.681417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 329/624] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:13 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:14.370147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.371253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:14.386607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.387441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.388718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.389425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.439036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b876571f-add9-4e22-a84e-2f6f4ef7656a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.326632 Jul 20 21:57:14.443102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 296/625] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:57:12 2022] POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments => generated 194 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:14.544970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.545671 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:14.552649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.553099 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.553960 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.554399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.593062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.601151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-93bff00e-bbe4-4f36-a1ce-071f5e7abf17 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1547 microversion: 2.1 time: 0.235724 Jul 20 21:57:14.601740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 330/626] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1547 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:14.618610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.619503 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:14.626050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.626425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.627259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.627689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.753848 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.770083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.773891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.775316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-da095be4-926d-4d14-bfde-9d7f8bfef533 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.234951 Jul 20 21:57:14.776016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 297/627] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:14.786234 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.786836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:14.793299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.793753 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.794517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.794950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.809301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.816691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ef77c7e2-cb52-4217-a838-8b0e45e3ec85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1547 microversion: 2.1 time: 0.202488 Jul 20 21:57:14.817264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 331/628] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1547 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:14.833126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.837240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.838032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Searching by: {'deleted': False, 'project_id': 'c17214008914495b8083b74c6fc9e405'} {{(pid=124151) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 21:57:14.840046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:14.846247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.846687 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.847511 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.847942 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.934718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:14.941897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.multi_cell_list [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124151) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 21:57:14.942442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-90e28c85-6bb8-4f67-95cc-da035308cd28 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1557 microversion: 2.1 time: 0.159992 Jul 20 21:57:14.943016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 298/629] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:14.961788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:14.962285 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:14.968574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.969026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:14.969793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:14.970223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:15.039326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0ac8c09e-34ab-465c-819a-8b21f1a64cfb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209695 Jul 20 21:57:15.040277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 332/630] 10.222.0.86 () {58 vars in 1124 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:57:15.049926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:15.050544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:15.052887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cb8118dc-2a31-4415-8beb-d968afd48d05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095170 Jul 20 21:57:15.053487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 299/631] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:57:14 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:15.057536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:15.057987 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:15.058756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:15.059213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:15.345869 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:15.358815 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1bef5a46-d1ad-4d36-b4be-dcf355af78de tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1547 microversion: 2.1 time: 0.312262 Jul 20 21:57:15.360065 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 333/632] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:15 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1547 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:15.796207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:15.797178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:15.799282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:15.805726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:15.806296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:15.807184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:15.807693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:16.041138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:16.050190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:16.051735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:16.052908 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-973d7ace-0073-46a6-91ce-d96b0ce7c37b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.261132 Jul 20 21:57:16.053481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 300/633] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:15 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:16.265270 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-48bc9462-f926-44f8-add1-01ce59288325 req-aded487c-6cc9-48ae-8f86-50214b31907d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9", "tag": "a5f53cca-80b8-4956-8307-f129ce9f38f0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:16.276255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-48bc9462-f926-44f8-add1-01ce59288325 req-aded487c-6cc9-48ae-8f86-50214b31907d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:16.277005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-48bc9462-f926-44f8-add1-01ce59288325 req-aded487c-6cc9-48ae-8f86-50214b31907d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:16.289831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-48bc9462-f926-44f8-add1-01ce59288325 req-aded487c-6cc9-48ae-8f86-50214b31907d service nova] Creating event network-changed:a5f53cca-80b8-4956-8307-f129ce9f38f0 for instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 on hv-cinder-84969 Jul 20 21:57:16.294858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-48bc9462-f926-44f8-add1-01ce59288325 req-aded487c-6cc9-48ae-8f86-50214b31907d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035702 Jul 20 21:57:16.295504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 334/634] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:17.017181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2791370e-706a-4259-b539-8a42b8cc1550"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:17.018956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:17.029695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:17.030370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:17.031630 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:17.032287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:17.074086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:17.075085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:17.087411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:17.088082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:17.089264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:17.089954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:17.258026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:17.266868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:17.268413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:17.269656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-aa414ec8-aea9-4ff1-b5f4-a887392c9a9e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.200792 Jul 20 21:57:17.270214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 335/635] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:17 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:17.955675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c915e445-c998-4a7d-a472-4c14441cf613 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944783 Jul 20 21:57:17.960507 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 301/636] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:57:17 2022] POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:18.290094 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:18.291088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:18.298101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:18.298547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:18.299346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:18.299773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:18.529556 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:18.541864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:18.543635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:18.544995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f03e7d14-2a36-467e-bfb4-fe8eea9c2fd3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.259510 Jul 20 21:57:18.545551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 336/637] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:18 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:19.565547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:19.566241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:19.573737 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:19.574186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:19.574951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:19.575415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:19.724576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:19.733930 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:19.735474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:19.736702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-082e6ab7-6383-4f56-b60b-8caa6f935a6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.175430 Jul 20 21:57:19.737265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 302/638] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:19 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:20.755551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:20.756165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:20.762499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:20.762946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:20.763743 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:20.764178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:20.894990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:20.904200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:20.905761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:20.906955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-22ef1f40-a334-4c9d-952a-3b91b9ddeb92 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.155541 Jul 20 21:57:20.907552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 337/639] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:20 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:21.926013 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:21.926705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:21.933995 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:21.934448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:21.935237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:21.935670 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:22.074539 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:22.083559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:22.085690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:22.087217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3d9a201b-456d-484a-8141-720ad9892a62 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.165114 Jul 20 21:57:22.088067 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 303/640] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:21 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:22.679621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-5648145c-1389-4a88-8b97-39a78146955b req-2f23abbc-ea6f-4fbd-bb60-21892980cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "name": "network-vif-plugged", "status": "completed", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:22.691912 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-5648145c-1389-4a88-8b97-39a78146955b req-2f23abbc-ea6f-4fbd-bb60-21892980cba1 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:22.692547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-5648145c-1389-4a88-8b97-39a78146955b req-2f23abbc-ea6f-4fbd-bb60-21892980cba1 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:22.714545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-5648145c-1389-4a88-8b97-39a78146955b req-2f23abbc-ea6f-4fbd-bb60-21892980cba1 service nova] Creating event network-vif-plugged:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:57:22.722530 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-5648145c-1389-4a88-8b97-39a78146955b req-2f23abbc-ea6f-4fbd-bb60-21892980cba1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046656 Jul 20 21:57:22.723185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 338/641] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:23.105493 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:23.106087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:23.113032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:23.113482 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:23.114243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:23.114672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:23.130518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:23.257899 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:23.266497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:23.268195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:23.269371 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-935c0505-3338-4524-996f-91adcdd7fec3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.167755 Jul 20 21:57:23.269928 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 304/642] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:23 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:24.289847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:24.290735 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:24.300095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:24.300648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:24.301860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:24.302736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:24.469420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:24.478629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:24.480175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:24.481346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-06a18eee-01f6-4d85-bea9-0615ffb1f3d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.197214 Jul 20 21:57:24.481914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 339/643] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:24 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:25.292628 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:25.293664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:25.300195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.300631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.301396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.301834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.324802 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'flavor' on Instance uuid 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:57:25.454542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4ea37bb0-c8e6-4351-9d94-1bbb3fe01de9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/action" status: 200 len: 32 microversion: 2.1 time: 0.166256 Jul 20 21:57:25.464654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 305/644] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:57:25 2022] POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 21:57:25.478309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:25.479311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:25.488304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:25.491452 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.492212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.495806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.496492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.508996 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:25.510833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:25.524956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.525911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.527396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:25.528257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:25.830583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:25.833579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:25.839871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-623c8334-46de-4051-94cb-d770fee354ac tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.369397 Jul 20 21:57:25.846123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:25.848150 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:25.849831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6b537364-7c3a-4cfe-b0d2-c4310836c3be tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.350957 Jul 20 21:57:25.850144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 340/645] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:25 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:25.851314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 306/646] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:25 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:26.857923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:26.858614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:26.865320 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:26.865765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:26.867618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:26.867618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:26.872700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:26.873691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:26.884176 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:26.884977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:26.886636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:26.887347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:27.151801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:27.157993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:27.160458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8a4431ee-0d87-4ac8-a042-710a5fc6dcc1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.306339 Jul 20 21:57:27.161297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 341/647] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:26 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:27.167190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:27.168710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:27.169871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-04fa0b87-b678-43f9-b9f0-837f1f89b2e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.302715 Jul 20 21:57:27.170681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 307/648] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:26 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:57:28.178167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:28.180280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:28.189122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:28.189659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:28.197263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:28.197720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:28.198501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:28.198931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:28.202420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:28.202873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:28.203673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:28.204109 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:28.415029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:28.418989 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:28.423296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0398b785-7cfb-43a0-961d-78b427d0faf6 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.248952 Jul 20 21:57:28.423874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 342/649] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:28 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:28.428047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:28.429948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:28.431141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-75344d55-eddb-43bb-95db-d2a5d5c08033 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1807 microversion: 2.20 time: 0.246153 Jul 20 21:57:28.431685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 308/650] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:28 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:29.443670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:29.444225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:29.450941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:29.451641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:29.451830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:29.452185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:29.453012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:29.453449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:29.457927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:29.458498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:29.460486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:29.460486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:29.664368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:29.671204 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:29.672551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d41c8625-bc61-4671-afcf-d3aaafca2fe9 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.232750 Jul 20 21:57:29.673131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 343/651] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:29 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:29.691554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:29.693379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:29.694774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-533901aa-7f32-4dfb-bea9-b7b087222f0b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1794 microversion: 2.20 time: 0.247474 Jul 20 21:57:29.695433 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 309/652] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:57:29 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1794 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:57:30.699682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:30.700736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:30.707146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:30.707613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:30.708385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:30.708820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:30.846281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:30.855931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2fd7a9d1-e824-4bee-8d66-dacd9bb29422 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.160082 Jul 20 21:57:30.856509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 344/653] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:30 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:31.874038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:31.874644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:31.882393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:31.882969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:31.883912 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:31.884353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:32.018813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:32.027003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ab7e49fd-5681-4d79-ba09-910ef4ed9540 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.157174 Jul 20 21:57:32.027617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 310/654] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:31 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:33.045602 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:33.046148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:33.052966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:33.053411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:33.054505 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:33.054940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:33.190390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:33.193814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:33.199890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-13675920-0c91-4bc2-a4a2-8fc333af9bf0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.158331 Jul 20 21:57:33.200463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 345/655] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:33 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:34.033360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:34.033980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:34.040723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:34.041174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:34.041942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:34.042379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:34.176865 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:34.185822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2a2b743e-30eb-422d-b4e8-4adcb1862167 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1593 microversion: 2.1 time: 0.156151 Jul 20 21:57:34.186411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 311/656] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:34 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:34.216884 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:34.217502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:34.224431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:34.224881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:34.225783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:34.226536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:34.434256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:34.442882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5f56b7de-9d6a-41d7-8853-eb2f18e6928b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.229831 Jul 20 21:57:34.443615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 346/657] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:34 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:35.461825 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:35.462468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:35.469314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:35.469765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:35.470899 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:35.471016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:36.116923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:36.125565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bd13f485-c45c-423b-8116-2e0b543e894f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.668303 Jul 20 21:57:36.126085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 312/658] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:35 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:36.516568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-cb5e6beb-73c0-4d21-bf7b-5033a7ace526 req-0d8bc8fb-1508-40cf-89b2-64bc9917c368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:36.526900 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-cb5e6beb-73c0-4d21-bf7b-5033a7ace526 req-0d8bc8fb-1508-40cf-89b2-64bc9917c368 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:36.527741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-cb5e6beb-73c0-4d21-bf7b-5033a7ace526 req-0d8bc8fb-1508-40cf-89b2-64bc9917c368 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:36.541100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-cb5e6beb-73c0-4d21-bf7b-5033a7ace526 req-0d8bc8fb-1508-40cf-89b2-64bc9917c368 service nova] Creating event network-changed:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 21:57:36.546593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-cb5e6beb-73c0-4d21-bf7b-5033a7ace526 req-0d8bc8fb-1508-40cf-89b2-64bc9917c368 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033598 Jul 20 21:57:36.547652 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 347/659] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:57:37.145970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:37.148950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:37.159280 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:37.160262 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:37.162030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:37.163534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:37.466020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:37.482867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cebfdf19-81c0-4041-a97b-d016ae94bd38 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.341538 Jul 20 21:57:37.483541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 313/660] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:37 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:37.802512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-117113324"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:37.803222 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:37.810003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:37.810456 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:37.811267 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:37.811706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:37.940540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.network.security_group_api [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Adding security group 8ae75024-ef2d-49d3-884f-90adec236a1b to port af8e0902-594b-48c4-ae9f-5f18ed045896 Jul 20 21:57:38.319919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1b33fe77-8764-482d-8b6f-568ea2daa5c8 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action" status: 202 len: 0 microversion: 2.1 time: 0.521510 Jul 20 21:57:38.322018 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 348/661] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:57:37 2022] POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:57:38.334101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:38.335159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:38.342502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:38.342957 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:38.344685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:38.345813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:38.501982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:38.503175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:38.512019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:38.512812 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:38.513868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:38.514689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:38.641923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:38.653950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7c6b87b3-572c-4577-bac0-7256e1278416 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1758 microversion: 2.1 time: 0.324978 Jul 20 21:57:38.655030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 314/662] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:38 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1758 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:38.662058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-6a4d9023-157e-4365-8551-a3ba9824e5d7 req-4fd87ab6-0d07-40c5-8cac-3b0f1a93d8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:38.674114 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6a4d9023-157e-4365-8551-a3ba9824e5d7 req-4fd87ab6-0d07-40c5-8cac-3b0f1a93d8b1 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:38.675663 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6a4d9023-157e-4365-8551-a3ba9824e5d7 req-4fd87ab6-0d07-40c5-8cac-3b0f1a93d8b1 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:38.702022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-6a4d9023-157e-4365-8551-a3ba9824e5d7 req-4fd87ab6-0d07-40c5-8cac-3b0f1a93d8b1 service nova] Creating event network-changed:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 21:57:38.714590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-6a4d9023-157e-4365-8551-a3ba9824e5d7 req-4fd87ab6-0d07-40c5-8cac-3b0f1a93d8b1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055824 Jul 20 21:57:38.716600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 315/663] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:57:38.766820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:38.777163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ce458b1c-805e-40a5-b24e-69f74c24a467 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.280689 Jul 20 21:57:38.789585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 349/664] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:38 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:39.796256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:39.796952 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:39.804326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:39.804780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:39.805556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:39.806000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:39.994704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:40.003939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4bad78f1-e717-4057-9b47-0acf94a639d0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.212431 Jul 20 21:57:40.004526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 316/665] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:39 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:40.111280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:40.112119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:40.122582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:40.123279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:40.124428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:40.125067 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:40.302726 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lazy-loading 'services' on Instance uuid cd54893a-7604-4639-97b3-049128aac78b {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:57:40.418537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fe608a48-709a-4c74-a801-d415f84c281d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments/4522c8fe-de70-4348-acbd-0a68c3c2ae4e" status: 202 len: 0 microversion: 2.1 time: 0.313457 Jul 20 21:57:40.419203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 350/666] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 21:57:40 2022] DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments/4522c8fe-de70-4348-acbd-0a68c3c2ae4e => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:57:41.021456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:41.022318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:41.029326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:41.029787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:41.030551 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:41.031009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:41.170798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:41.179824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6491a072-8fae-457c-89f1-8ba601ce28c3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.161905 Jul 20 21:57:41.180406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 317/667] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:41 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:42.197292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:42.197880 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:42.204839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:42.205276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:42.206033 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:42.206459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:42.392108 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:42.401749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7e876193-d824-4e7d-bc00-20659aeccbde tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.208785 Jul 20 21:57:42.402315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 351/668] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:42 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:42.598868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b49d254b-f3a9-4e2f-b646-c7416dcf32bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:42.606083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b49d254b-f3a9-4e2f-b646-c7416dcf32bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:42.606538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b49d254b-f3a9-4e2f-b646-c7416dcf32bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:42.670953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b49d254b-f3a9-4e2f-b646-c7416dcf32bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Going to try to stop instance {{(pid=124150) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 21:57:42.717242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:42.729875 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b49d254b-f3a9-4e2f-b646-c7416dcf32bf tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action" status: 202 len: 0 microversion: 2.1 time: 0.134872 Jul 20 21:57:42.730489 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 318/669] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:57:42 2022] POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:57:42.738652 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:42.739316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:42.746243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:42.746692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:42.747855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:42.748286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:42.898235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:42.905704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-41f2f632-d0ff-4d70-8ce1-07cf952a4313 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.170969 Jul 20 21:57:42.906271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 352/670] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:42 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:43.421252 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:43.422268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:43.431601 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:43.432367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:43.433370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:43.433859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:43.652113 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:43.660518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6513a4e1-759d-48c2-9963-1cae17b35cfa tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.245389 Jul 20 21:57:43.661227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 319/671] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:43 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:43.924214 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:43.925279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:43.933613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:43.934192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:43.935083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:43.935616 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:44.080844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:44.090669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a11977b5-2d11-4ea9-aad5-40a3b2e01f1a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.171417 Jul 20 21:57:44.091300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 353/672] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:43 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:44.679349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:44.679973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:44.686579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:44.687091 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:44.687862 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:44.688487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:44.834901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:44.843735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-21f376ca-9090-4e4c-a405-f123c7a5a479 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.169416 Jul 20 21:57:44.844332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 320/673] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:44 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:45.108918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:45.109524 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:45.112008 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=44 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:45.117753 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:45.118203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:45.118966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:45.119423 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:45.259491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:45.267036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-66b2e4ff-591a-49cb-8843-2eaf9ddac66f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.161919 Jul 20 21:57:45.267618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 354/674] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:45 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:45.861490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:45.862104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:45.864542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=42 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:45.870521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:45.870972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:45.871770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:45.872479 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:46.010013 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:46.018389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d1cfe561-2925-4447-a87c-922e7db42fb8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.160763 Jul 20 21:57:46.018969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 321/675] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:45 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:46.285497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:46.286188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:46.293300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:46.293751 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:46.294518 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:46.294951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:46.430567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:46.438350 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-29477941-d768-4f51-816c-a60b18bdc11a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.156890 Jul 20 21:57:46.438917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 355/676] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:46 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:47.037057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:47.038218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:47.044819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:47.045264 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:47.046026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:47.046461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:47.183193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:47.191190 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b4b1f8b7-766d-4f18-8bbf-a1bebbe3dd04 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.158104 Jul 20 21:57:47.191764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 322/677] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:47 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:47.455761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:47.456384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:47.462945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:47.463449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:47.464200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:47.464638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:47.599134 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:47.607352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f3130723-6558-4ce8-8dd8-773c7a3bb2f6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.155472 Jul 20 21:57:47.607928 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 356/678] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:47 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:48.210000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:48.210606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:48.217102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:48.217549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:48.218310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:48.218747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:48.355276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:48.363247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d80bdc58-552d-45a6-8b8f-a8fc93694e34 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.157724 Jul 20 21:57:48.363823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 323/679] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:48 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:48.625576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:48.626144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:48.632905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:48.633351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:48.634208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:48.634638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:48.769084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:48.777574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b2f5bb07-fe5e-42ca-8295-9d49d5c60b54 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.156083 Jul 20 21:57:48.778142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 357/680] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:48 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:49.382088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:49.382781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:49.389240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:49.389685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:49.390461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:49.390889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:49.526313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:49.534243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0fa47e5c-e1d8-46fd-a147-946f91ad29d7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.156992 Jul 20 21:57:49.534808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 324/681] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:49 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:49.795785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:49.796374 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:49.802925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:49.804157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:49.805096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:49.805527 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:49.938403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:49.946510 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3df304e5-a8c7-422d-b20f-fddb86a211fe tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.154558 Jul 20 21:57:49.947043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 358/682] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:49 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:50.552024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:50.552625 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:50.560092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:50.560546 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:50.561329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:50.561767 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:50.698311 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:50.706466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5b194627-7a45-47dd-808b-554abd55f322 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.158333 Jul 20 21:57:50.707038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 325/683] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:50 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:50.964218 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:50.964766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:50.971330 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:50.971770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:50.972529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:50.972994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:51.113021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:51.120858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cc4bc5c6-0b8f-4e25-88b2-4def35408bc7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.161489 Jul 20 21:57:51.121435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 359/684] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:50 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:51.723711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:51.724356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:51.731199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:51.731638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:51.732399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:51.732836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:51.890042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:51.899563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-52fcd9d6-0ef9-4a92-a824-17c2d4398a9e tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.179615 Jul 20 21:57:51.900289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 326/685] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:51 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:52.137737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:52.138355 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:52.145081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:52.145539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:52.146305 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:52.146747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:52.282185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:52.290901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f880cdf9-6e9f-41eb-a85b-7ea5c85c6332 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.157031 Jul 20 21:57:52.291546 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 360/686] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:52 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:52.917104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:52.917714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:52.924270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:52.924727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:52.925460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:52.925891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:53.058265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:53.067250 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ac04bf90-e96a-45da-85e5-1bbbd27ebf62 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.153996 Jul 20 21:57:53.067823 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 327/687] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:52 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:53.308741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:53.309339 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:53.316075 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:53.316524 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:53.317287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:53.317723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:53.454966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:53.464440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c53121cc-9303-408a-8f68-bae634257827 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.159473 Jul 20 21:57:53.465764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 361/688] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:53 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:54.086461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:54.087142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:54.093731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:54.094184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:54.094954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:54.095430 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:54.266663 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:54.275903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-98712101-bf87-4970-ab66-a74a0d894187 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.194459 Jul 20 21:57:54.276598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 328/689] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:54 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:54.482684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:54.483331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:54.490208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:54.490948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:54.491766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:54.492198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:54.653315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:54.656836 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:57:54.661841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d861a678-583e-4b45-ad2d-6d528050e0c5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.183868 Jul 20 21:57:54.662519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 362/690] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:54 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:55.294460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:55.295377 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:55.304216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:55.304957 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:55.306273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:55.306273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:55.530861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:55.539114 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1dd43651-8d52-493e-b048-6d815c747b7c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.248741 Jul 20 21:57:55.539719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 329/691] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:55 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:55.682054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:55.682951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:55.692594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:55.693151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:55.694002 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:55.694442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:55.838877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:55.850219 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9333cfc9-b463-4ef8-afcd-42ddbb1cd46e tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.174916 Jul 20 21:57:55.850988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 363/692] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:55 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:56.559302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:56.560310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:56.571148 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:56.571917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:56.573154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:56.573932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:56.734332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:56.743226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a8c8993d-9c71-4b5e-80d6-2cfb59b936c4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1736 microversion: 2.1 time: 0.190041 Jul 20 21:57:56.744106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 330/693] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:56 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:56.868606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:56.869391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:56.876025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:56.876463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:56.877231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:56.877720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:57.024039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:57.031567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9e6ab856-82c6-4f2d-97ea-eadc623f255d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.167673 Jul 20 21:57:57.032143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 364/694] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:56 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:57.762255 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:57.762916 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:57.769355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:57.769808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:57.770569 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:57.771004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:57.904648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:57.912739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-55951d16-304c-43fe-beb8-9e39e45e7a97 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1716 microversion: 2.1 time: 0.154450 Jul 20 21:57:57.913455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 331/695] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:57 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:58.015489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:58.015996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:58.022548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.023005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.023802 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.024241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.049368 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:58.049979 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:58.057041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.057499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.058270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.058709 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.110640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] HTTP exception thrown: Cannot 'detach_volume' instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 while it is in vm_state rescued Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Request method failure captured: Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments/66c3b0ec-4fe2-4833-89ed-87dd84f6ae12 HTTP/1.1 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk6rdg9RgXTwJ4yevFyc3pHFPX4zPiiCC8ZK0Y8Rr_6nca1sdd-TXSJWznYPm2PhbvMRrBgJ7BfLGdS8f3tlvKSsU44by5miUt1w4ySdqLYYmFR373GWJ8kWQyt-Gty7rF4rBS3AnUmxsWqin4j5RcqWQghoar5cdQTNi4dVlqEGW4 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:57:58.112439 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_80320a3595ce4d4cb7c468b0fbec6580", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}] Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 1a0d4ce0ac4d47c8a184ea0291461379 Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:57:58.114026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Cannot 'detach_volume' instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 while it is in vm_state rescued Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'server_id': '46f3b4d0-6885-44cc-8f6f-fe1cf8249df6', 'id': '66c3b0ec-4fe2-4833-89ed-87dd84f6ae12'} Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:57:58.114712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 while it is in vm_state rescued Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 while it is in vm_state rescued Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:57:58.116656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Returning 409 to user: Cannot 'detach_volume' instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 while it is in vm_state rescued {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:57:58.117617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-263d5dfb-ec6f-45d6-a856-7eea26c9b778 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments/66c3b0ec-4fe2-4833-89ed-87dd84f6ae12" status: 409 len: 152 microversion: 2.1 time: 0.102412 Jul 20 21:57:58.117617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 365/696] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 21:57:58 2022] DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments/66c3b0ec-4fe2-4833-89ed-87dd84f6ae12 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 21:57:58.123914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:57:58.124450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:58.130588 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.131085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.131883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.132322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.195649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:58.199922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b16c2585-cc2e-417d-b7a0-cbd6e6412b0a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/action" status: 202 len: 0 microversion: 2.1 time: 0.079830 Jul 20 21:57:58.203547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 366/697] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:57:58 2022] POST /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 21:57:58.203713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bd7c6dc0-2a23-43b0-a276-b985d6d12497 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.157819 Jul 20 21:57:58.204023 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 332/698] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:58 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:57:58.208794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:58.209705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:58.216190 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.216649 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.217416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:58.217853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:58.351947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:58.360045 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9fcf09ca-9b57-4471-8df9-73f2190c01c2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1724 microversion: 2.1 time: 0.155190 Jul 20 21:57:58.360613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 367/699] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:58 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:59.220712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:59.221327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:59.229182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:59.229640 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:59.230422 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:59.230863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:59.378314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:57:59.379184 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:57:59.386011 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:59.386459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:59.387318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:57:59.387779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:57:59.450879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:59.458363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-953d8be1-d84d-4aa5-8d01-47a76249955c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.241588 Jul 20 21:57:59.460106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 333/700] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:59 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:57:59.563162 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:57:59.571929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-efd4a67c-e9f0-4a3b-87d6-674bf3bd68d5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1724 microversion: 2.1 time: 0.197422 Jul 20 21:57:59.572712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 368/701] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:57:59 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:00.476336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:00.476956 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:00.483537 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:00.483993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:00.484760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:00.485195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:00.589278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:00.589894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:00.596324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:00.596772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:00.597543 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:00.597980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:00.619731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:00.627668 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f5c64abd-217f-441c-8439-bb70ddee9d8b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.155076 Jul 20 21:58:00.628335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 334/702] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:00 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:00.783321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:00.791768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3d3ba59c-7d5e-4d72-9b8a-880b3ceb0782 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1724 microversion: 2.1 time: 0.206482 Jul 20 21:58:00.792341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 369/703] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:00 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:01.344342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 21:58:01.344545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 21:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 21:58:01.645547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:01.646090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:01.652746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:01.653203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:01.654006 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:01.654441 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:01.669237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:01.784870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:01.793220 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-33c979ee-ff4a-4ea0-ae01-069aee33530c tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.151739 Jul 20 21:58:01.793792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 335/704] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:01 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:01.808856 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:01.809464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:01.815990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:01.816436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:01.817186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:01.817615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:01.951114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:01.959120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4f0c3481-f222-4f53-b5a7-2a9e4600a91d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1724 microversion: 2.1 time: 0.153953 Jul 20 21:58:01.959877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 370/705] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:01 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:02.919287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:02.919941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:02.925858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:02.926302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:02.927081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:02.927523 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:02.976946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:02.977539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:02.984487 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:02.984935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:02.985696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:02.986124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:03.102541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:03.111466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b4ba614b-a06b-459d-8a2e-cd1c0d8cef50 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1677 microversion: 2.1 time: 0.305377 Jul 20 21:58:03.127107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 336/706] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:02 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:03.149645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:03.157667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7a9dcd22-c866-4564-ab5a-d0e5b05d641a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1724 microversion: 2.1 time: 0.185181 Jul 20 21:58:03.158233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 371/707] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:02 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:04.134961 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:04.135590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:04.142127 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.142579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.143363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.143801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.175474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:04.176225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:04.185438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.185970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.186800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.187387 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.332732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:04.340727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-51971066-606c-4ded-ba1e-11babe6d6d8a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1654 microversion: 2.1 time: 0.209662 Jul 20 21:58:04.341323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 337/708] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:04 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1654 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:04.356903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-80aec299-b372-4930-89db-d1fc4950cee7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:04.360247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:04.363004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-80aec299-b372-4930-89db-d1fc4950cee7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.363501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-80aec299-b372-4930-89db-d1fc4950cee7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.369259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-574bf08b-5686-4189-8db5-b6e1bb5b459b tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1730 microversion: 2.1 time: 0.197512 Jul 20 21:58:04.369822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 372/709] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:04 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:04.386352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-80aec299-b372-4930-89db-d1fc4950cee7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Going to try to start instance {{(pid=124150) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 21:58:04.386858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:04.387371 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:04.393283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.393756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.394514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.394945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.429511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-80aec299-b372-4930-89db-d1fc4950cee7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action" status: 202 len: 0 microversion: 2.1 time: 0.076146 Jul 20 21:58:04.430501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 338/710] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:58:04 2022] POST /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 21:58:04.439982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:04.440690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:04.447087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.447559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.448458 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:04.448947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:04.480285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8bc4c5a3-3b8c-40ca-bb2a-34c2773b75b7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096379 Jul 20 21:58:04.480980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 373/711] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:58:04 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:58:04.643173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:04.650958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8ede6a4f-fabc-47aa-a2ec-b6e5bd097b26 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1663 microversion: 2.1 time: 0.216092 Jul 20 21:58:04.651840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 339/712] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:04 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1663 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:05.395386 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-68b8b66b-9125-4ea0-aa89-212f58c73ab3 req-007d60af-484a-4bae-964f-f4299b37d721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:05.405545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68b8b66b-9125-4ea0-aa89-212f58c73ab3 req-007d60af-484a-4bae-964f-f4299b37d721 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:05.405545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68b8b66b-9125-4ea0-aa89-212f58c73ab3 req-007d60af-484a-4bae-964f-f4299b37d721 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:05.418978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-68b8b66b-9125-4ea0-aa89-212f58c73ab3 req-007d60af-484a-4bae-964f-f4299b37d721 service nova] Creating event network-changed:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:58:05.423735 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-68b8b66b-9125-4ea0-aa89-212f58c73ab3 req-007d60af-484a-4bae-964f-f4299b37d721 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032565 Jul 20 21:58:05.424344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 374/713] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:05.669175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:05.669887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:05.676733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:05.677269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:05.678145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:05.679818 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:05.869341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:05.877805 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7346f5d2-b8de-42ce-9722-b37491686388 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1663 microversion: 2.1 time: 0.212334 Jul 20 21:58:05.878300 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 340/714] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:05 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1663 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:06.894841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:06.895561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:06.902791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:06.903284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:06.904035 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:06.904460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:07.037111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:07.045332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c70fbc55-5679-424b-ac4f-98a033906d92 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1667 microversion: 2.1 time: 0.154579 Jul 20 21:58:07.045893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 375/715] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:06 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:07.438857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-b9266d2d-6219-4dcf-8594-9d55aaa3a964 req-ee88e98f-11da-45db-b240-8f43f0840e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:07.447963 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-b9266d2d-6219-4dcf-8594-9d55aaa3a964 req-ee88e98f-11da-45db-b240-8f43f0840e48 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:07.448403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-b9266d2d-6219-4dcf-8594-9d55aaa3a964 req-ee88e98f-11da-45db-b240-8f43f0840e48 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:07.458939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-b9266d2d-6219-4dcf-8594-9d55aaa3a964 req-ee88e98f-11da-45db-b240-8f43f0840e48 service nova] Creating event network-changed:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:58:07.463759 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-b9266d2d-6219-4dcf-8594-9d55aaa3a964 req-ee88e98f-11da-45db-b240-8f43f0840e48 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028801 Jul 20 21:58:07.464324 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 341/716] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:31.302044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:31.302898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:31.305380 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=43 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:31.306421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:31.312282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.312733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.313506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.313943 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.384994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-461e0df2-1eac-4e8e-a97b-952fd6f7f8f6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action" status: 202 len: 0 microversion: 2.1 time: 0.086996 Jul 20 21:58:31.385827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 376/717] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:58:31 2022] POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:58:31.394441 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:31.395254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:31.398289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=41 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:31.399124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:31.405521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.405974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.406752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.407211 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.597415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:31.606421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-12b983bc-036a-4cc3-af31-fbc0a1fb3a01 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1750 microversion: 2.1 time: 0.216163 Jul 20 21:58:31.607013 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 342/718] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:31 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:31.914109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:31.914109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:31.919101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.919542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.920301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.920729 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.944088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c355e5eb-b307-42fb-aa5f-b1f48b3ecc7f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/ips" status: 200 len: 150 microversion: 2.1 time: 0.146756 Jul 20 21:58:31.944644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 377/719] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 21:58:31 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/ips => generated 150 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:31.955696 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67aaadbf-46a0-4aa6-bc3d-6e9f3a676506"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:31.956841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:31.963820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.964272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:31.965046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:31.965481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.046271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: POST /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/os-volume_attachments HTTP/1.1 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 74 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:58:32.049591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {"volumeAttachment": {"volumeId": "67aaadbf-46a0-4aa6-bc3d-6e9f3a676506"}} Jul 20 21:58:32.051446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'server_id': '8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9', 'body': {'volumeAttachment': {'volumeId': '67aaadbf-46a0-4aa6-bc3d-6e9f3a676506'}}} Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:32.052504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:32.054087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 400 to user: Invalid volume: volume 67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 is already attached to instances: 5a027718-c5db-48a7-bafd-4b4130e2380a {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-79bcda2e-409c-4456-aaae-187f6d4323b2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098025 Jul 20 21:58:32.055755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 343/720] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 21:58:31 2022] POST /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 21:58:32.059489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:32.059996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:32.065948 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.066398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.067199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.067635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.093669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:58:32.176571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c1f01923-fea6-4b04-801a-f367d4438143 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 204 len: 0 microversion: 2.1 time: 0.121316 Jul 20 21:58:32.177408 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 378/721] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:58:32 2022] DELETE /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:58:32.186749 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:32.187407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:32.194111 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.194611 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.195442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.195873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.337110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:32.344576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d8438ac8-f89f-4279-8709-d2cc577e3b4b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1682 microversion: 2.1 time: 0.161650 Jul 20 21:58:32.345155 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 344/722] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:32 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:32.625309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:32.625914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:32.632511 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.632952 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.633705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:32.634142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:32.780642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:32.788827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-07e54c52-afa7-41b1-a49b-c3e4242bb7b3 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.168138 Jul 20 21:58:32.789399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 379/723] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:32 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:33.362449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:33.362975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:33.369509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.369961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.370733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.371197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.411607 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:33.412171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:33.418553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.419009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.419810 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.420252 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.453095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cb9ff556-b993-4f14-a02c-b913b13a0484 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments/50aff643-cffd-4f06-a6d8-8b597bd5b392" status: 200 len: 194 microversion: 2.20 time: 0.166615 Jul 20 21:58:33.453684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 345/724] 10.222.0.86 () {60 vars in 1453 bytes} [Wed Jul 20 21:58:33 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments/50aff643-cffd-4f06-a6d8-8b597bd5b392 => generated 194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 21:58:33.511155 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:33.518993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-58e7d957-2179-4344-8b8b-0b5292e29f0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1682 microversion: 2.1 time: 0.160467 Jul 20 21:58:33.519506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:33.519639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 380/725] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:33 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:33.520010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:33.526871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.527350 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.528187 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.528632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.652730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lazy-loading 'services' on Instance uuid 6f8a564c-d369-4d26-836f-0d5498d8cbc9 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:33.765313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-57e4c575-368c-45d8-bc1a-7d07fe0ab87a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments/50aff643-cffd-4f06-a6d8-8b597bd5b392" status: 202 len: 0 microversion: 2.20 time: 0.249647 Jul 20 21:58:33.765904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 346/726] 10.222.0.86 () {60 vars in 1456 bytes} [Wed Jul 20 21:58:33 2022] DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments/50aff643-cffd-4f06-a6d8-8b597bd5b392 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 21:58:33.774263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:33.775327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:33.781807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.782262 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.783022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.783483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.808539 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:33.809051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:33.814183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-27761cee-8142-463f-b68a-83183178fb5b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043760 Jul 20 21:58:33.814970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 381/727] 10.222.0.86 () {60 vars in 1342 bytes} [Wed Jul 20 21:58:33 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 21:58:33.815322 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.815774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.816538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:33.816971 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:33.965001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:33.972876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fdb46c14-2d2d-4831-8de4-abb262d2b2fb tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.170025 Jul 20 21:58:33.973441 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 347/728] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:33 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:34.537855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:34.538786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:34.546027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:34.546476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:34.548141 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:34.548580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:34.689482 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:34.697413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ff10a597-0666-4cbd-a88a-8bc5f62c2809 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1682 microversion: 2.1 time: 0.163789 Jul 20 21:58:34.698193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 382/729] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:34 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:34.826218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:34.827141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:34.833758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:34.834209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:34.834980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:34.835473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:34.866039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-62c0812a-4fcd-430e-a044-7163f4db94ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043936 Jul 20 21:58:34.866626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 348/730] 10.222.0.86 () {60 vars in 1342 bytes} [Wed Jul 20 21:58:34 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:58:34.990477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:34.991111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:34.998566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:34.999017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:34.999814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:35.000372 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:35.154915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:35.163263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5cf3a076-fae6-4163-9034-43e15ba5e8ff tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.176536 Jul 20 21:58:35.163838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 383/731] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:34 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:35.715732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:35.716340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:35.722306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:35.722752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:35.723726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:35.724180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:35.878504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:35.879691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:35.887864 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:35.888316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:35.889164 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:35.889604 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:35.922019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b6f2355e-d5b1-477e-86fd-43423c34cd1c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047590 Jul 20 21:58:35.922612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 384/732] 10.222.0.86 () {60 vars in 1342 bytes} [Wed Jul 20 21:58:35 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 21:58:36.021656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:36.030323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-00142945-ffdd-44de-bba0-12b53cdc534a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1682 microversion: 2.1 time: 0.319242 Jul 20 21:58:36.031173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 349/733] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:35 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1682 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:36.182909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:36.184410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:36.193000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:36.193736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:36.195690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:36.196185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:36.773470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:36.782429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-36f2db9f-1ddf-4ff9-a3c1-22db0e50e2e6 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.604675 Jul 20 21:58:36.783012 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 385/734] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:36 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:36.934324 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:36.935277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:36.942182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:36.943129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:36.945061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:36.945600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.015865 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-01d8689c-0f2e-4e36-8731-f1a2b69a7b17 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083346 Jul 20 21:58:37.021238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 350/735] 10.222.0.86 () {60 vars in 1342 bytes} [Wed Jul 20 21:58:36 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:37.033609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-1f6c871c-e1ac-4fb4-a5dd-dabc101a4912 req-cee4239a-cebe-458f-8e8f-e8be7b50ad36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9", "name": "network-vif-deleted", "tag": "a5f53cca-80b8-4956-8307-f129ce9f38f0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:37.048272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:37.048887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:37.049038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1f6c871c-e1ac-4fb4-a5dd-dabc101a4912 req-cee4239a-cebe-458f-8e8f-e8be7b50ad36 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.049496 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1f6c871c-e1ac-4fb4-a5dd-dabc101a4912 req-cee4239a-cebe-458f-8e8f-e8be7b50ad36 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.062541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.063008 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.066553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.067019 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.068777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-1f6c871c-e1ac-4fb4-a5dd-dabc101a4912 req-cee4239a-cebe-458f-8e8f-e8be7b50ad36 service nova] Creating event network-vif-deleted:a5f53cca-80b8-4956-8307-f129ce9f38f0 for instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 on hv-cinder-84969 Jul 20 21:58:37.092043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-1f6c871c-e1ac-4fb4-a5dd-dabc101a4912 req-cee4239a-cebe-458f-8e8f-e8be7b50ad36 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127818 Jul 20 21:58:37.097465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 386/736] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:58:37.119764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:37.120789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:37.128425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.129161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.130144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.130892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.162724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:37.164199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:58:37.172792 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-899dee7e-923d-4884-ac0b-d4bf9de78649 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1326 microversion: 2.1 time: 0.128748 Jul 20 21:58:37.174010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 351/737] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:37 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:37.253569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-479a3c7b-7dc0-4ba1-9e23-ab5316bb818c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 204 len: 0 microversion: 2.20 time: 0.138612 Jul 20 21:58:37.254260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 387/738] 10.222.0.86 () {60 vars in 1279 bytes} [Wed Jul 20 21:58:37 2022] DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 21:58:37.263332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:37.263943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:37.270470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.270922 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.271724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.272336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.412495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:37.420953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:37.422478 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:37.423670 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-027eba98-a7e4-4eb5-8a43-5f4e520b3641 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.165253 Jul 20 21:58:37.424232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 352/739] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:37 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:37.800833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:37.801596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:37.808597 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.809335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.810304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:37.810932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:37.972166 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:37.981047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e17f8cad-5904-4cdb-afd4-b1509a0d7a02 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.184361 Jul 20 21:58:37.981866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 388/740] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:37 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:38.189707 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:38.190450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:38.197771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:38.198303 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:38.199179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:38.199689 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:38.230691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:38.231085 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:38.231538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:38.273483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:38.281119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b69ac16e-f81c-4657-8f15-d5468c91c238 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1331 microversion: 2.1 time: 0.095233 Jul 20 21:58:38.282029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 353/741] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:38 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:38.441980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:38.442594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:38.449748 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:38.450202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:38.450962 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:38.451428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:38.455509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:38.585459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:38.594394 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:38.595982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:38.597686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fce9d5b0-3100-43a5-9069-72693e869763 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.159688 Jul 20 21:58:38.606427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 389/742] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:38 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:39.001034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:39.001655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:39.008237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.008703 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.010206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.010647 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.165298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:39.174654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b2790c22-a22c-4612-98d0-f4caca498264 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.177811 Jul 20 21:58:39.179251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 354/743] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:38 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:39.298843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:39.299488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:39.305601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.306060 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.306910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.307409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.338876 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.339340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.339783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:39.383497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:39.392181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be44de93-9084-4f2a-8143-897224f7f5a8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 200 len: 1331 microversion: 2.1 time: 0.097209 Jul 20 21:58:39.392758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 390/744] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:39 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:39.616723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:39.617335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:39.624487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.624948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.625926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:39.626364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:39.758240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:39.766228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:39.767774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:39.768929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cff23b45-44a8-4ca6-9965-0f2d8077f315 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.156158 Jul 20 21:58:39.769480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 355/745] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:39 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:40.192848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:40.193455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:40.200118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.200569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:40.201328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.201759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:40.348365 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:40.356920 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be4e3db0-a11b-4c6f-b081-c97000882143 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.168778 Jul 20 21:58:40.357485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 391/746] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:40 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:40.409779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:40.410403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:40.417077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.417542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:40.418291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.418725 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:40.431861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 HTTP/1.1 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:58:40.433525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 21:58:40.435138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9'} Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:58:40.435954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 21:58:40.437297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:40.438395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:58:40.438395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0e1c84aa-1b5e-48c8-92bb-012588a362f3 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 404 len: 111 microversion: 2.1 time: 0.029077 Jul 20 21:58:40.438395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 356/747] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:40 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:58:40.444118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9242cde8-ba19-42b2-906d-757c003b3f83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '.version_select at 0x7f6aba4c9af0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:40.463793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9242cde8-ba19-42b2-906d-757c003b3f83 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490405374" status: 202 len: 0 microversion: 2.1 time: 0.023394 Jul 20 21:58:40.464384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 392/748] 10.222.0.86 () {58 vars in 1217 bytes} [Wed Jul 20 21:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490405374 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:58:40.790096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:40.791172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:40.798104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.798575 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:40.799366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:40.799820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.009621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:41.019545 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:41.021815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:41.023352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-40f7a4cc-150a-4501-a4bb-9f25f45a2b43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1722 microversion: 2.20 time: 0.238869 Jul 20 21:58:41.025743 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 357/749] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:40 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:58:41.170231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:41.170821 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:41.177017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.177472 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.178237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.178671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.261913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'services' on Instance uuid 5a027718-c5db-48a7-bafd-4b4130e2380a {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:41.345325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e10d27d3-7abc-44e0-900a-99164d21be95 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments/67aaadbf-46a0-4aa6-bc3d-6e9f3a676506" status: 202 len: 0 microversion: 2.1 time: 0.178782 Jul 20 21:58:41.346407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 393/750] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 21:58:41 2022] DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments/67aaadbf-46a0-4aa6-bc3d-6e9f3a676506 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:58:41.362610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:41.363910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-531f87ab-fe7c-4f6e-b6fa-501bc1491357 req-841d27b3-3156-48ab-80d4-25eef2fa4bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a564c-d369-4d26-836f-0d5498d8cbc9", "name": "network-vif-deleted", "tag": "d240758e-572d-4706-b77a-881ca07d28e7"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:41.364276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:41.375390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-531f87ab-fe7c-4f6e-b6fa-501bc1491357 req-841d27b3-3156-48ab-80d4-25eef2fa4bc2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.375831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-531f87ab-fe7c-4f6e-b6fa-501bc1491357 req-841d27b3-3156-48ab-80d4-25eef2fa4bc2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.389220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-531f87ab-fe7c-4f6e-b6fa-501bc1491357 req-841d27b3-3156-48ab-80d4-25eef2fa4bc2 service nova] Creating event network-vif-deleted:d240758e-572d-4706-b77a-881ca07d28e7 for instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 on hv-cinder-84969 Jul 20 21:58:41.392185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.394107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.394569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-531f87ab-fe7c-4f6e-b6fa-501bc1491357 req-841d27b3-3156-48ab-80d4-25eef2fa4bc2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034772 Jul 20 21:58:41.395006 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.397653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.398283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 394/751] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:58:41.407924 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:41.408172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:41.409165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:41.417013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.417750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.418706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:41.419463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:41.475713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d002b3c2-28a3-4e52-abd1-1430b0ce3296 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124279 Jul 20 21:58:41.481766 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 358/752] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:58:41 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:41.626841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:41.640980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bf542fea-0537-4e16-afbb-6065d60bc78b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.241186 Jul 20 21:58:41.641567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 395/753] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:41 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:42.043491 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:42.044131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:42.050964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.051452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.052222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.052657 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.089145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.089612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.090076 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lazy-loading 'fault' on Instance uuid 6f8a564c-d369-4d26-836f-0d5498d8cbc9 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:42.132488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:42.141467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:42.142977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:42.144218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-76801c8b-9d67-4a6b-a71d-af58b39c5f7a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 200 len: 1371 microversion: 2.20 time: 0.105357 Jul 20 21:58:42.144775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 359/754] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:42 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:42.489011 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:42.489924 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:42.497357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.497794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.498820 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.499488 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.531824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4880fb5f-a118-4045-9f66-30c951c366fc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Jul 20 21:58:42.532401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 396/755] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:58:42 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:42.659128 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:42.659692 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:42.667431 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.667890 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.668679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:42.669112 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:42.819997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:42.829139 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4e9e1250-451d-4cc2-a275-8ecfbca53a85 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.173574 Jul 20 21:58:42.837035 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 360/756] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:42 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:43.162914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.163551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:43.170167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.170621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.171409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.171847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.185528 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 HTTP/1.1 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:58:43.187233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 21:58:43.188833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '6f8a564c-d369-4d26-836f-0d5498d8cbc9'} Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:58:43.189848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 21:58:43.191130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:58:43.192486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:58:43.192486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-636886b4-99c5-4a53-87e5-296b5ab77ed8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 404 len: 111 microversion: 2.20 time: 0.029634 Jul 20 21:58:43.192486 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 397/757] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:43 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 21:58:43.197747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-127d4fa9-8ff4-40f2-a5f3-1e488c3cbd38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '.version_select at 0x7f6aba6b0dc0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.216797 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-127d4fa9-8ff4-40f2-a5f3-1e488c3cbd38 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779103835" status: 204 len: 0 microversion: 2.20 time: 0.023045 Jul 20 21:58:43.217351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 361/758] 10.222.0.86 () {60 vars in 1261 bytes} [Wed Jul 20 21:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779103835 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 21:58:43.544001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.544902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:43.551341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.551793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.552551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.552988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.583120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2ee153a7-0c99-4d92-924e-fb9a43fe3497 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044126 Jul 20 21:58:43.583683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 398/759] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:58:43 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 21:58:43.643955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.644470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:43.650721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.651216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.651998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.652439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.679142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:58:43.767901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-59b6a186-9149-4dc6-ab0a-7042e92d8255 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 204 len: 0 microversion: 2.1 time: 0.127713 Jul 20 21:58:43.768859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 362/760] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:58:43 2022] DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:58:43.777142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.777749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:43.783844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.784384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.785172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.785601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.848417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:43.849124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:43.855879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.856855 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.857666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:43.857786 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:43.965551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:43.973209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-11158eeb-796b-4436-925e-97f403dd48fe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1682 microversion: 2.1 time: 0.200267 Jul 20 21:58:43.973790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 399/761] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:43 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:43.978987 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2f02b882-ba74-4612-bae8-b4ec300be0f2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: .version_select at 0x7f6aba4dc9d0>, body: {"keypair": {"name": "tempest-keypair-1117601613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkYOctyvOUls3XJz2BARxeBSJB59DvM2DXqQlOKBvoH5ObfWH9y9X0pAal68EteGMpp7vkIt4YJmW4hybuvxnAEs4mGQWtd4oRsxRC9Hgonlj/mG/NaQtHm/iatXePzeg=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:43.992887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-2f02b882-ba74-4612-bae8-b4ec300be0f2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:58:43.997724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-2f02b882-ba74-4612-bae8-b4ec300be0f2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for user fb27ee14314f42cc87e8e6bac2031c70 and project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:58:44.020148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2f02b882-ba74-4612-bae8-b4ec300be0f2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045254 Jul 20 21:58:44.020738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 400/762] 10.222.0.86 () {62 vars in 1199 bytes} [Wed Jul 20 21:58:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 21:58:44.028988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:44.037072 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-95fb9097-96f0-44ef-a818-bec1ca051d18 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.193241 Jul 20 21:58:44.037685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 363/763] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:43 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:44.991582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:44.992327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:44.999288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:44.999861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:45.000764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:45.001252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:45.062952 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:45.064104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:45.073798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:45.074264 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:45.075048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:45.075506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:45.193473 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:45.201963 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c0f08789-d1b2-4c39-8be9-c09a281343a1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1682 microversion: 2.1 time: 0.214805 Jul 20 21:58:45.203125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 401/764] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:44 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:45.262274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:45.270791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3f523913-9c35-4ffc-b9e3-9c9ce2f92961 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.217471 Jul 20 21:58:45.271406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 364/765] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:45 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:45.468259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1478688529", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25cda20e-f9f2-497a-b842-ac835141a913"}], "security_groups": [{"name": "tempest-securitygroup--2062387401"}], "key_name": "tempest-keypair-1117601613", "user_data": "}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:45.652513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] validate_networks() for [('25cda20e-f9f2-497a-b842-ac835141a913', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:58:46.219374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:46.220574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:46.226737 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:46.227235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:46.228992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:46.228992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:46.860541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:46.868275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d9dad549-b433-426b-ae1d-2b8c0b026fbc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1682 microversion: 2.1 time: 0.652776 Jul 20 21:58:46.868960 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 365/766] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:46 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1682 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:46.874362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:46.875199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:46.881492 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:46.881974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:46.882868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:46.883326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.155763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:58:47.156240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:58:47.156799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:58:47.159353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:58:47.159934 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:58:47.172484 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.172925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.173909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.174342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.192203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:58:47.197733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Getting quotas for user fb27ee14314f42cc87e8e6bac2031c70 and project 37e4a1ceb7b94c4ea11fbbeb8ee0c006. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:58:47.209816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:58:47.213400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:58:47.267619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3f569dca-3d9d-4e44-a6a1-aadc8bbba3e7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.804025 Jul 20 21:58:47.273708 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 402/767] 10.222.0.86 () {62 vars in 1187 bytes} [Wed Jul 20 21:58:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 21:58:47.277703 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:47.279852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:47.280728 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:47.289660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2cf462cb-1d02-4542-9e73-fa73bc41579b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.418803 Jul 20 21:58:47.293870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:47.302917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 366/768] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:46 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:47.353923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:47.369338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:47.370821 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:47.371993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5405c16c-3c14-4a45-9b77-c3e7b788ecc7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1282 microversion: 2.20 time: 0.096519 Jul 20 21:58:47.372641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 403/769] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:47 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:47.532541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-20474a6a-39fa-44e7-92ab-e8c315c68b80 req-26a69bb0-bf25-4b2b-b4fd-081aaf7e4af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a027718-c5db-48a7-bafd-4b4130e2380a", "name": "network-vif-deleted", "tag": "ded61c9e-a55f-4fb8-8822-17313fc2edcf"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:47.548251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-20474a6a-39fa-44e7-92ab-e8c315c68b80 req-26a69bb0-bf25-4b2b-b4fd-081aaf7e4af7 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.549133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-20474a6a-39fa-44e7-92ab-e8c315c68b80 req-26a69bb0-bf25-4b2b-b4fd-081aaf7e4af7 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.563681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-20474a6a-39fa-44e7-92ab-e8c315c68b80 req-26a69bb0-bf25-4b2b-b4fd-081aaf7e4af7 service nova] Creating event network-vif-deleted:ded61c9e-a55f-4fb8-8822-17313fc2edcf for instance 5a027718-c5db-48a7-bafd-4b4130e2380a on hv-cinder-84969 Jul 20 21:58:47.569861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-20474a6a-39fa-44e7-92ab-e8c315c68b80 req-26a69bb0-bf25-4b2b-b4fd-081aaf7e4af7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040853 Jul 20 21:58:47.571276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 367/770] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:47.889049 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:47.889779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:47.897086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.897542 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.898528 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.898757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.937208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:47.937779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:47.939027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid 5a027718-c5db-48a7-bafd-4b4130e2380a {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:47.982557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:47.990216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c8472acf-5f68-457f-bbca-1ed867e12d71 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1332 microversion: 2.1 time: 0.107398 Jul 20 21:58:47.990797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 404/771] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:47 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:48.320552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:48.321976 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:48.328366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:48.328814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:48.329574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:48.330000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:48.391239 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:48.391871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:48.399680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:48.400902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:48.401685 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:48.402118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:48.476883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:48.488930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:48.490537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:48.492030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bc878ec4-ee52-498b-bf5e-bac25f782516 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1278 microversion: 2.20 time: 0.104928 Jul 20 21:58:48.493113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 405/772] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:48 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:58:48.518677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:48.530167 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6a0789be-293a-4ed0-bcdc-5b0344ca2af0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.214245 Jul 20 21:58:48.530858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 368/773] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:48 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:49.007842 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:49.008599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:49.016217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.016669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.017446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.017879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.053575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.054031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.054582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid 5a027718-c5db-48a7-bafd-4b4130e2380a {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:58:49.098402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:49.106648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8f15138e-32aa-40e0-9d03-ea23ec1d06dd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 200 len: 1332 microversion: 2.1 time: 0.102766 Jul 20 21:58:49.107248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 406/774] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:49 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:49.512504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:49.513117 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:49.521655 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.522144 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.522936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.523930 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.547245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:49.547989 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:49.554460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.555177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.557152 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:49.557770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:49.621785 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:49.630877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:49.632541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:49.634485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-af873731-7f5c-4094-9e17-285f65da7c68 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1342 microversion: 2.20 time: 0.126422 Jul 20 21:58:49.635988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 369/775] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:49 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1342 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:49.789755 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:49.798294 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1afedbae-2812-4dfc-9cc3-554d660abe5d tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.254856 Jul 20 21:58:49.798856 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 407/776] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:49 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:50.125514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:50.126133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:50.132291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.132752 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:50.133523 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.134672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:50.148360 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a HTTP/1.1 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 21:58:50.150043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 21:58:50.151656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '5a027718-c5db-48a7-bafd-4b4130e2380a'} Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:58:50.152502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 21:58:50.153905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 21:58:50.156222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:58:50.156222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7bdb18e1-b84a-42fe-9635-7d059001cefa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 404 len: 111 microversion: 2.1 time: 0.030903 Jul 20 21:58:50.156222 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 370/777] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:50 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:58:50.160766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3a6ad1ec-d666-45f0-878d-349147a6defd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '.version_select at 0x7f6aba581b80>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:50.179627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3a6ad1ec-d666-45f0-878d-349147a6defd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029290524" status: 202 len: 0 microversion: 2.1 time: 0.023087 Jul 20 21:58:50.180294 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 408/778] 10.222.0.86 () {58 vars in 1220 bytes} [Wed Jul 20 21:58:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029290524 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:58:50.661459 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:50.662073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:50.670107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.670560 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:50.671368 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.671801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:50.815960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:50.817225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:50.825633 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.826085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:50.826855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:50.827309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:51.030240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:51.038245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:51.039786 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:51.041641 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c06ecac2-a13c-42ea-9802-220ee3ec8a8f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.384319 Jul 20 21:58:51.042206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 371/779] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:50 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:51.204189 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:51.213313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-61fb7057-0273-4e37-b1e4-6f90817b7aa1 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.401114 Jul 20 21:58:51.213893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 409/780] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:50 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:51.350011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-358cb559-2681-460f-be4e-2cc6e8b79682 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: .version_select at 0x7f6aba513670>, body: {"keypair": {"name": "tempest-keypair-376511447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+nsiNB2DtcGd29xGgcG+NVJMB6VqQTsZp8FXbhWDxK0GwyPFrAVi/Pd1EzWs7tDZFoLhH8aqUcVNFiy0Dl7tvH8wT1c4gH5Mwo5E2cz2CnUSjo+L1thj18eAx4UyyW0g=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:51.364380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-358cb559-2681-460f-be4e-2cc6e8b79682 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:58:51.368393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-358cb559-2681-460f-be4e-2cc6e8b79682 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:58:51.391141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-358cb559-2681-460f-be4e-2cc6e8b79682 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044934 Jul 20 21:58:51.391748 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 372/781] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:58:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:58:51.896958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-c0f8aff2-221b-4bcf-b9c5-bb01b69990c7 req-362e4579-43e4-4b6a-be87-4baf054fc137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:51.912066 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c0f8aff2-221b-4bcf-b9c5-bb01b69990c7 req-362e4579-43e4-4b6a-be87-4baf054fc137 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:51.913009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c0f8aff2-221b-4bcf-b9c5-bb01b69990c7 req-362e4579-43e4-4b6a-be87-4baf054fc137 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:51.938233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:51.940982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-c0f8aff2-221b-4bcf-b9c5-bb01b69990c7 req-362e4579-43e4-4b6a-be87-4baf054fc137 service nova] Creating event network-changed:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 21:58:51.947153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-c0f8aff2-221b-4bcf-b9c5-bb01b69990c7 req-362e4579-43e4-4b6a-be87-4baf054fc137 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070411 Jul 20 21:58:51.947895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 410/782] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:52.061887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:52.062485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:52.070295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:52.071101 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:52.072475 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:52.073215 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:52.235506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:52.236462 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:52.246349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:52.247190 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:52.248440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:52.249036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:52.279884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:52.291803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:52.293755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:52.295149 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f1d231cd-f8cf-4ca1-a5d4-2403dc7784c7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.237797 Jul 20 21:58:52.296731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 373/783] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:52 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:58:52.491126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:52.501072 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0c6461af-4796-42d7-af2d-58ff803444b2 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.270192 Jul 20 21:58:52.512145 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 411/784] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:52 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:52.959954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-686811930", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e24c0e-fc60-4c54-b80d-8c328d2228f9"}], "security_groups": [{"name": "tempest-securitygroup--1381093109"}], "key_name": "tempest-keypair-376511447", "user_data": "}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:53.061552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] validate_networks() for [('54e24c0e-fc60-4c54-b80d-8c328d2228f9', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:58:53.314130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:53.314670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:53.321166 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.322356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.323165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.323606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.824252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:53.832425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:53.833996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:53.835440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-42d7c662-9c22-4bd1-b6bb-aa74f7a7333d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.525238 Jul 20 21:58:53.836009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 412/785] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:53 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 21:58:53.841133 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:53.841974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:53.847346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:58:53.847850 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:58:53.848236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:58:53.848641 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:58:53.849048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:58:53.855964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.856410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.857182 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.857610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.859496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.859974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.860777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:53.861220 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:53.878421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:58:53.882392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:58:53.892204 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:53.894880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:58:53.897186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:58:53.946506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0b643ac6-392a-43a6-93af-a308b8480202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.990695 Jul 20 21:58:53.947486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 374/786] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:58:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:58:53.957091 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fb2e2e93-d0b5-4d83-8198-800caadb4db1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:53.957736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fb2e2e93-d0b5-4d83-8198-800caadb4db1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:54.025330 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fb2e2e93-d0b5-4d83-8198-800caadb4db1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:54.034384 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fb2e2e93-d0b5-4d83-8198-800caadb4db1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1240 microversion: 2.1 time: 0.081021 Jul 20 21:58:54.034962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 375/787] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:53 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:54.044471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:54.050478 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5b2f918d-18b0-412e-81d0-852dbdaeea49 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.213447 Jul 20 21:58:54.051278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 413/788] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:53 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:54.855125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:54.855740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:54.863118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:54.863579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:54.864358 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:54.864799 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:55.032184 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:55.040659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:55.042435 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:55.044728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d989f1eb-337a-417c-b656-e214b2eee9b2 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.193888 Jul 20 21:58:55.044728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 376/789] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:54 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:55.053101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:55.053833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:55.064951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:55.065816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:55.067202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:55.068022 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:55.068170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:55.069099 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:55.078251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:55.078707 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:55.079726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:55.081744 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:55.232689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:55.240794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-97cd2915-3b43-47ab-981a-9ec6635dfccc tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1300 microversion: 2.1 time: 0.191478 Jul 20 21:58:55.241375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 414/790] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:55 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:55.362040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:55.365638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:55.373501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6050b3c9-fd06-4326-b6be-7d969fb5be89 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.309458 Jul 20 21:58:55.374094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 377/791] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:55 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:56.062589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:56.063826 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:56.072383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.073408 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.074485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.075161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.217042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:56.225285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:56.226792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:56.228082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8b513d86-3e39-4760-80e4-a6928da10151 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.169574 Jul 20 21:58:56.228739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 415/792] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:56 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:56.262536 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:56.263110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:56.271684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.272134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.272892 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.273323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.392337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:56.392945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:56.400240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.400689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.401461 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:56.402121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:56.414347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:56.424503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8801198f-486a-41a6-9c3d-ec59d7b2fee8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.166603 Jul 20 21:58:56.425095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 378/793] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:56 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:56.550381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:56.558250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a6182b0b-96b9-4267-b0f4-d60c920d7d80 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1755 microversion: 2.1 time: 0.169825 Jul 20 21:58:56.558826 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 416/794] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:56 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:58:57.249404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:57.250454 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:57.258114 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.260379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.261579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.263486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.439410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:57.441424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=12 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:58:57.447612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:57.449212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:57.469922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.475958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.478344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.478917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.494746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:57.506643 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:57.508506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:57.511632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-346f456f-a6ff-430f-8ec5-91f5cd7d6857 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.269798 Jul 20 21:58:57.512209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 379/795] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:57 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:57.529470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-d87df21a-7404-4655-b703-d3df2a227c51 req-a9cb952f-095d-4ba1-b195-81a52daf790d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20c7cdc-854d-4d66-91d9-6b6da979ee15", "tag": "9e7ef3c5-d778-4021-abb1-a30bc2f284cc"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:57.538315 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-d87df21a-7404-4655-b703-d3df2a227c51 req-a9cb952f-095d-4ba1-b195-81a52daf790d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.539221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-d87df21a-7404-4655-b703-d3df2a227c51 req-a9cb952f-095d-4ba1-b195-81a52daf790d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.552240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-d87df21a-7404-4655-b703-d3df2a227c51 req-a9cb952f-095d-4ba1-b195-81a52daf790d service nova] Creating event network-changed:9e7ef3c5-d778-4021-abb1-a30bc2f284cc for instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 on hv-cinder-84969 Jul 20 21:58:57.558462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-d87df21a-7404-4655-b703-d3df2a227c51 req-a9cb952f-095d-4ba1-b195-81a52daf790d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044899 Jul 20 21:58:57.559552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 380/796] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:57.579560 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:57.580319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:57.587728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.588331 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.589142 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:57.589576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:57.767789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:57.776293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e078f103-7841-405e-9825-6678fb16bea7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.338253 Jul 20 21:58:57.786622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 417/797] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:57 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:57.877333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:57.885769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4fd9aaba-42a4-42cd-9d88-5fb6ceed8d72 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1758 microversion: 2.1 time: 0.313282 Jul 20 21:58:57.886369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 381/798] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:57 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1758 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:58.528773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:58.529386 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:58.535941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:58.536396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:58.537148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:58.537580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:58.669480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:58.677470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:58.678960 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:58.680073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9aa472d4-a1fa-4424-9cda-4200e4ecd0fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.155284 Jul 20 21:58:58.681349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 418/799] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:58 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:58:58.794025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:58.794541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:58.801094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:58.801552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:58.802315 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:58.802756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:58.937660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:58.945048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-70020d82-b972-4648-90cb-9ece7e3536b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.155513 Jul 20 21:58:58.945650 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 382/800] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:58 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:58:59.219706 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-a8a0b94c-27be-499a-90a3-5ab56a295ce7 req-cca617b9-04ee-4a0e-9bcd-f891529a36e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "name": "network-vif-plugged", "status": "completed", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:58:59.227963 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a8a0b94c-27be-499a-90a3-5ab56a295ce7 req-cca617b9-04ee-4a0e-9bcd-f891529a36e3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:59.228425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a8a0b94c-27be-499a-90a3-5ab56a295ce7 req-cca617b9-04ee-4a0e-9bcd-f891529a36e3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:59.239032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-a8a0b94c-27be-499a-90a3-5ab56a295ce7 req-cca617b9-04ee-4a0e-9bcd-f891529a36e3 service nova] Creating event network-vif-plugged:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 21:58:59.244391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-a8a0b94c-27be-499a-90a3-5ab56a295ce7 req-cca617b9-04ee-4a0e-9bcd-f891529a36e3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086205 Jul 20 21:58:59.245069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 419/801] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:58:59.698712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:59.699544 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:59.706719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:59.707266 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:59.708244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:59.708694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:59.964632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:58:59.965420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:58:59.971245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:59.972393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:59.972921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:59.973777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:58:59.974348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:58:59.981301 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:59.982826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:58:59.983968 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1324dfc3-a0c7-4a40-99d4-5673e1b19804 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.290088 Jul 20 21:58:59.984525 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 383/802] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:58:59 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:59:00.158320 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:00.166324 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-eedfeb32-ed70-4159-94ac-5f4bc902ad47 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.207297 Jul 20 21:59:00.166880 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 420/803] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:58:59 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:01.004214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:01.004819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:01.012171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:01.012616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:01.013391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:01.013820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:01.147943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:01.157850 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:01.159411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:01.160516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2b12dbb4-864a-4abc-92db-6243a5306410 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1408 microversion: 2.20 time: 0.160430 Jul 20 21:59:01.161079 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 384/804] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:59:00 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:59:01.183861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:01.184480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:01.191473 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:01.191759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:01.192521 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:01.192951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:01.344615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:01.354293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3f90bc07-6f12-4442-83dd-bda79a1c21e7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.175064 Jul 20 21:59:01.354873 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 421/805] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:01 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:02.178862 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:02.179502 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:02.186448 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.186896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.187690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.188114 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.319546 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:02.329734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:02.331736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:02.332821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-107a1ede-c849-4ccd-bd00-ff9dd1dc388d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1600 microversion: 2.20 time: 0.157819 Jul 20 21:59:02.333380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 385/806] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 21:59:02 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 21:59:02.350273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:02.350769 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:02.357230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.357674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.358536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.358966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.370586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:02.371226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:02.377447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.377902 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.378674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:02.379134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:02.466000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b388d528-e713-444e-98f6-946fb245ddd1 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119509 Jul 20 21:59:02.466798 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 422/807] 10.222.0.86 () {60 vars in 1315 bytes} [Wed Jul 20 21:59:02 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 21:59:02.531923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:02.539437 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-61b7ff47-a54b-44bd-8225-3d304b8e81fa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.173183 Jul 20 21:59:02.540578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 386/808] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:02 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:03.270978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-0f5bd8b4-91a2-44d6-9fce-77bc85181d11 req-aed285a9-09ee-4708-94c4-19bd0c1de2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20c7cdc-854d-4d66-91d9-6b6da979ee15", "name": "network-vif-plugged", "status": "completed", "tag": "9e7ef3c5-d778-4021-abb1-a30bc2f284cc"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:03.283001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0f5bd8b4-91a2-44d6-9fce-77bc85181d11 req-aed285a9-09ee-4708-94c4-19bd0c1de2cb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.283636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0f5bd8b4-91a2-44d6-9fce-77bc85181d11 req-aed285a9-09ee-4708-94c4-19bd0c1de2cb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.298622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-0f5bd8b4-91a2-44d6-9fce-77bc85181d11 req-aed285a9-09ee-4708-94c4-19bd0c1de2cb service nova] Creating event network-vif-plugged:9e7ef3c5-d778-4021-abb1-a30bc2f284cc for instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 on hv-cinder-84969 Jul 20 21:59:03.304645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-0f5bd8b4-91a2-44d6-9fce-77bc85181d11 req-aed285a9-09ee-4708-94c4-19bd0c1de2cb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 Jul 20 21:59:03.305694 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 423/809] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:03.530777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-0ef16990-da2a-4552-af6e-5b5a3878c2b3 req-8b5af28a-f057-4b58-bc1d-6c73503edd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:03.533559 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:03.534300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:03.539686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-0ef16990-da2a-4552-af6e-5b5a3878c2b3 req-8b5af28a-f057-4b58-bc1d-6c73503edd47 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.540172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-0ef16990-da2a-4552-af6e-5b5a3878c2b3 req-8b5af28a-f057-4b58-bc1d-6c73503edd47 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.541389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.542070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.542843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.543457 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.551809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-0ef16990-da2a-4552-af6e-5b5a3878c2b3 req-8b5af28a-f057-4b58-bc1d-6c73503edd47 service nova] Creating event network-changed:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 21:59:03.558642 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-0ef16990-da2a-4552-af6e-5b5a3878c2b3 req-8b5af28a-f057-4b58-bc1d-6c73503edd47 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104694 Jul 20 21:59:03.560189 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 387/810] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:03.567627 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:03.568647 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:03.576540 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.577286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.578107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.578939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.646831 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'services' on Instance uuid 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:59:03.723213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f240668d-cffd-45b1-b381-86be8be35c41 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments/66c3b0ec-4fe2-4833-89ed-87dd84f6ae12" status: 202 len: 0 microversion: 2.1 time: 0.193465 Jul 20 21:59:03.727185 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 424/811] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 21:59:03 2022] DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments/66c3b0ec-4fe2-4833-89ed-87dd84f6ae12 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 21:59:03.732861 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:03.734307 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:03.741828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.742274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.744125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:03.744855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:03.780024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-94bceb55-2476-4676-9a9b-5b6d57190da8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051289 Jul 20 21:59:03.784263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 425/812] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:59:03 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:03.793693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:03.801162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a07222fb-d704-4639-af8f-1d8a6b813dbe tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.239468 Jul 20 21:59:03.801887 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 388/813] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:03 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:04.792178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:04.793116 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:04.799682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:04.800126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:04.800879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:04.801309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:04.819049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:04.819685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:04.821774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:04.822555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=12 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:04.829958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:04.830409 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:04.831221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:04.831665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:04.834235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0b71bce4-65c0-44c2-9e3b-19752c241544 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Jul 20 21:59:04.839027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 426/814] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:59:04 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:04.964206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:04.971499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-df9fafe6-b22e-4008-9e1f-7b7476d00139 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.156522 Jul 20 21:59:04.972066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 389/815] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:04 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:05.847306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:05.848352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:05.857596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:05.858387 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:05.859431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:05.859883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:05.898306 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d595ee11-e104-4fcf-8c7b-6704acddce94 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054578 Jul 20 21:59:05.899902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 427/816] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:59:05 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:05.988770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:05.989393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:05.996267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:05.996720 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:05.997484 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:05.997922 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.139110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:06.146845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-203878fb-fc74-4ad5-9f83-5372e05a955d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1366 microversion: 2.1 time: 0.162005 Jul 20 21:59:06.147457 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 390/817] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:05 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:06.687522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:06.688846 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:06.697173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.697816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.698665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.699310 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.717577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:06.734932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-98ef7496-5cbd-4b7e-81f6-9451e4ce5b46 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052799 Jul 20 21:59:06.736225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 428/818] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:59:06 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 21:59:06.802909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:06.803446 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:06.810055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.810501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.811288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.811721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.837126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:59:06.911726 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:06.913357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:06.920905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f954ed59-b433-4a6b-9d62-c2639698cd48 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 204 len: 0 microversion: 2.1 time: 0.121718 Jul 20 21:59:06.925308 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 391/819] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:59:06 2022] DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:59:06.927265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.928332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.929942 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.931654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.937020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:06.938787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:06.947773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.948406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.950510 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:06.951045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:06.982050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be2ab84e-ed96-434c-bb8c-b5997533e4df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075205 Jul 20 21:59:06.982624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 429/820] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 21:59:06 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 21:59:07.067184 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:07.067701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:07.074325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.075248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.076031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.076454 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.103793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:59:07.114826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:07.124499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-458fa670-dde6-410d-85fd-fa18a4f6286a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.195888 Jul 20 21:59:07.125082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 392/821] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:06 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:07.164342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:07.165557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:07.172579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.173041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.173815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.174248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.185971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-221bf88e-2dc8-43f3-a9e0-6af21ec62996 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 204 len: 0 microversion: 2.1 time: 0.123745 Jul 20 21:59:07.187333 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 430/822] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:59:07 2022] DELETE /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 21:59:07.196540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:07.197417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:07.203512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.203969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.204741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.205180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.395817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:07.400611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:07.404221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0c4801ec-8ea0-4fae-bfb2-cdadf24d9d08 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1557 microversion: 2.1 time: 0.243839 Jul 20 21:59:07.404822 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 393/823] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:07 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:07.408650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-16f36fff-62d6-4112-95fb-cac5e44d72db tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.217341 Jul 20 21:59:07.409224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 431/824] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:07 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:07.423486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:07.424004 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:07.430198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.431203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.431977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:07.432416 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:07.436210 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:07.513030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6709b86f-ec18-4e60-898c-ef5acc164b74 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095425 Jul 20 21:59:07.513624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 394/825] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:59:07 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:08.142068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:08.142690 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:08.150692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:08.151180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:08.152021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:08.152449 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:08.302521 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:08.311031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7a3fdc11-638e-408b-9357-e237d06592b5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.172961 Jul 20 21:59:08.311626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 432/826] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:08 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:08.426466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:08.427096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:08.433506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:08.433955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:08.434740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:08.435182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:08.569292 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:08.577674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5e0d6585-448a-4b80-acee-8c7fc62fd3b4 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.155617 Jul 20 21:59:08.578271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 395/827] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:08 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:08.749069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-68d4efb3-4f3e-46c8-9bd2-ee35aec2d050 req-d1987dba-bf9d-45ec-990a-38c753265619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20c7cdc-854d-4d66-91d9-6b6da979ee15", "tag": "9e7ef3c5-d778-4021-abb1-a30bc2f284cc"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:08.757793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68d4efb3-4f3e-46c8-9bd2-ee35aec2d050 req-d1987dba-bf9d-45ec-990a-38c753265619 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:08.758237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68d4efb3-4f3e-46c8-9bd2-ee35aec2d050 req-d1987dba-bf9d-45ec-990a-38c753265619 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:08.769756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-68d4efb3-4f3e-46c8-9bd2-ee35aec2d050 req-d1987dba-bf9d-45ec-990a-38c753265619 service nova] Creating event network-changed:9e7ef3c5-d778-4021-abb1-a30bc2f284cc for instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 on hv-cinder-84969 Jul 20 21:59:08.775668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-68d4efb3-4f3e-46c8-9bd2-ee35aec2d050 req-d1987dba-bf9d-45ec-990a-38c753265619 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030797 Jul 20 21:59:08.776287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 433/828] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:59:09.328418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:09.328932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:09.334928 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:09.335407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:09.336165 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:09.336726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:09.489989 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:09.497863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-758e3345-4c7f-46dd-8253-83e90e0dd178 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.173331 Jul 20 21:59:09.498710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 396/829] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:09 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:09.595516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:09.596371 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:09.603733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:09.604179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:09.604946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:09.605373 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:09.754502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:09.762186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bf96db69-98b4-406a-93fe-c2b426bfcdb2 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.171396 Jul 20 21:59:09.762749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 434/830] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:09 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:10.516052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:10.516698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:10.523372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:10.523819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:10.524616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:10.525052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:10.658335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:10.666354 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-10e3ffd8-65c6-47f9-b4ce-95c80bcba5b3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.154195 Jul 20 21:59:10.666923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 397/831] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:10 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:10.778896 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:10.779535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:10.786029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:10.786470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:10.787256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:10.787675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:10.922582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:10.931356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5f28d558-821f-4fc6-970b-6c5af68b35d8 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.155474 Jul 20 21:59:10.932076 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 435/832] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:10 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:11.683666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:11.684281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:11.693606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:11.694411 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:11.695811 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:11.696653 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:11.837432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:11.845029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d4d80016-3f09-4c01-834e-b0a25a9a2f62 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.166010 Jul 20 21:59:11.845606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 398/833] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:11 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:11.948968 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:11.949536 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:11.956438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:11.956892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:11.957689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:11.958121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:12.093898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:12.105757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-38325c5b-e3f1-4ea2-8bea-50f2195c7d02 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.161273 Jul 20 21:59:12.106321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 436/834] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:11 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:12.863810 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:12.864404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:12.871096 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:12.871553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:12.872333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:12.872759 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:13.011870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:13.019415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bec59121-2c4a-4465-b716-ea867a733d02 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.159562 Jul 20 21:59:13.019986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 399/835] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:12 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:13.124198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:13.124801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:13.131480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:13.131930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:13.132688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:13.133119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:13.278198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:13.285879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6bf8f0ee-9fc4-4b8a-a7c4-3d10cac4db42 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.165857 Jul 20 21:59:13.286454 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 437/836] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:13 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:14.037295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:14.037940 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:14.045419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:14.045806 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:14.046817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:14.047247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:14.302771 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:14.303544 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:14.316460 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:14.316966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:14.317838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:14.318292 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:14.584363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:14.592879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-63a64e4d-4f3e-4dc2-98d4-8a1c9dcfd660 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1673 microversion: 2.1 time: 0.559458 Jul 20 21:59:14.593460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 400/837] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:14 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1673 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:14.839410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:14.848928 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-61a3855c-a961-45a0-8354-3cdf205faebe tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1690 microversion: 2.1 time: 0.549939 Jul 20 21:59:14.849657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 438/838] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:14 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1690 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:15.615111 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:15.616346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:15.624942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:15.625798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:15.626586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:15.627053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:15.752246 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:15.760836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8e3c0dda-7ec3-4769-80f5-1764740812f3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1606 microversion: 2.1 time: 0.153442 Jul 20 21:59:15.761498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 401/839] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:15 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:15.865986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:15.866965 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:15.873876 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:15.874332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:15.875123 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:15.875566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:15.997389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:16.007970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a806a9f3-248a-4583-9a99-77bace5b3d8a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1623 microversion: 2.1 time: 0.145778 Jul 20 21:59:16.010348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 439/840] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:15 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1623 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:16.051882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-e9da2812-b4bf-412e-8276-0137586e9194 req-01818834-ad81-4503-98ce-756840d5ca7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd54893a-7604-4639-97b3-049128aac78b", "name": "network-vif-deleted", "tag": "18e13523-1791-4e22-bd94-50f9617505c0"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:16.078192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e9da2812-b4bf-412e-8276-0137586e9194 req-01818834-ad81-4503-98ce-756840d5ca7e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:16.078877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e9da2812-b4bf-412e-8276-0137586e9194 req-01818834-ad81-4503-98ce-756840d5ca7e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:16.094804 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-e9da2812-b4bf-412e-8276-0137586e9194 req-01818834-ad81-4503-98ce-756840d5ca7e service nova] Creating event network-vif-deleted:18e13523-1791-4e22-bd94-50f9617505c0 for instance cd54893a-7604-4639-97b3-049128aac78b on hv-cinder-84969 Jul 20 21:59:16.125964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-e9da2812-b4bf-412e-8276-0137586e9194 req-01818834-ad81-4503-98ce-756840d5ca7e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078142 Jul 20 21:59:16.129764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 402/841] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:16.779142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:16.779799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:16.787112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:16.787623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:16.788622 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:16.789057 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:16.823724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:16.824203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:16.824830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lazy-loading 'fault' on Instance uuid cd54893a-7604-4639-97b3-049128aac78b {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:59:16.876055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:16.885161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-396837bd-123f-4b11-8118-cce3fc170ec0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 200 len: 1328 microversion: 2.1 time: 0.110756 Jul 20 21:59:16.885886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 440/842] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:16 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:17.029813 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:17.031618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:17.038824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:17.039440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:17.041015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:17.041484 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:17.078178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:17.078888 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:17.079527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'fault' on Instance uuid 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:59:17.128936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:17.138563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-55fffc1e-82d3-4c99-a7cd-39d27919cf36 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 200 len: 1336 microversion: 2.1 time: 0.114687 Jul 20 21:59:17.139810 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 403/843] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:17 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:17.902936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:17.903614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:17.906098 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:17.911435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:17.911891 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:17.912658 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:17.913101 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:17.928588 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b HTTP/1.1 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:59:17.930236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 21:59:17.931936 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'cd54893a-7604-4639-97b3-049128aac78b'} Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:59:17.932783 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 21:59:17.934201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:17.935557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:59:17.935557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ecbe255f-932c-4e26-91b1-adeb82eaf8f1 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 404 len: 111 microversion: 2.1 time: 0.033144 Jul 20 21:59:17.935557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 441/844] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:17 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:59:17.940616 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5ecd19da-1cf8-4546-88e7-b56d8edf6466 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '.version_select at 0x7f6aba538820>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:17.957584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5ecd19da-1cf8-4546-88e7-b56d8edf6466 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104392816" status: 202 len: 0 microversion: 2.1 time: 0.020663 Jul 20 21:59:17.958156 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 404/845] 10.222.0.86 () {58 vars in 1220 bytes} [Wed Jul 20 21:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104392816 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:59:18.156071 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:18.156710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:18.164044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:18.164565 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:18.171283 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-a100be8a-7c96-40cd-99f2-28bf68191ba1 req-b87cbf07-2fcb-4e66-b194-865c0789968b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f3b4d0-6885-44cc-8f6f-fe1cf8249df6", "name": "network-vif-deleted", "tag": "6599b29e-a1f7-43b4-beec-be8f14d1f653"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:18.175553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:18.176055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:18.185603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a100be8a-7c96-40cd-99f2-28bf68191ba1 req-b87cbf07-2fcb-4e66-b194-865c0789968b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:18.186308 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a100be8a-7c96-40cd-99f2-28bf68191ba1 req-b87cbf07-2fcb-4e66-b194-865c0789968b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:18.190624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] HTTP exception thrown: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Request method failure captured: Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 HTTP/1.1 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk6rdg9RgXTwJ4yevFyc3pHFPX4zPiiCC8ZK0Y8Rr_6nca1sdd-TXSJWznYPm2PhbvMRrBgJ7BfLGdS8f3tlvKSsU44by5miUt1w4ySdqLYYmFR373GWJ8kWQyt-Gty7rF4rBS3AnUmxsWqin4j5RcqWQghoar5cdQTNi4dVlqEGW4 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:59:18.192321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_80320a3595ce4d4cb7c468b0fbec6580", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}] Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 1a0d4ce0ac4d47c8a184ea0291461379 Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. Jul 20 21:59:18.193918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '46f3b4d0-6885-44cc-8f6f-fe1cf8249df6'} Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:59:18.194801 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. Jul 20 21:59:18.196910 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:18.198172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Returning 404 to user: Instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:59:18.198172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2fe6b7ea-5ac4-4511-9b25-d442fc6244fc tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6" status: 404 len: 111 microversion: 2.1 time: 0.042382 Jul 20 21:59:18.198172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 442/846] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:18 2022] GET /compute/v2.1/servers/46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 21:59:18.201141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-a100be8a-7c96-40cd-99f2-28bf68191ba1 req-b87cbf07-2fcb-4e66-b194-865c0789968b service nova] Creating event network-vif-deleted:6599b29e-a1f7-43b4-beec-be8f14d1f653 for instance 46f3b4d0-6885-44cc-8f6f-fe1cf8249df6 on hv-cinder-84969 Jul 20 21:59:18.205799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-42f3045e-3b59-48ce-ab1a-dd6200f2706c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '.version_select at 0x7f6aba44db80>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:18.206179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-a100be8a-7c96-40cd-99f2-28bf68191ba1 req-b87cbf07-2fcb-4e66-b194-865c0789968b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038866 Jul 20 21:59:18.207030 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 405/847] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:59:18.224800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-42f3045e-3b59-48ce-ab1a-dd6200f2706c tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620262144" status: 202 len: 0 microversion: 2.1 time: 0.022765 Jul 20 21:59:18.225403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 443/848] 10.222.0.86 () {58 vars in 1220 bytes} [Wed Jul 20 21:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620262144 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 21:59:18.636364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0f520a75-904d-4890-a5cf-ae88cc2d3d76 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: .version_select at 0x7f6aba4d0c10>, body: {"keypair": {"name": "tempest-keypair-1146868970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUbr6Df2zdG40OZOdGQBv3YntXpsPhnHaU8za7NNDgie80D/1oHU8XBjHgJBJSn1wMUxLuPK2Pf361Kv05ngwxwiTTvlVMdheEp85RWenm9LqSgmogRGndeW1Nm+W1Zeg=="}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:18.652418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0f520a75-904d-4890-a5cf-ae88cc2d3d76 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for project e722bb68652c48f588d8b53351c6f2a6. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:59:18.656383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0f520a75-904d-4890-a5cf-ae88cc2d3d76 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for user 60f7f43c067e4b819aeb488e9f09197a and project e722bb68652c48f588d8b53351c6f2a6. Resources: {'key_pairs'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:59:18.679011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0f520a75-904d-4890-a5cf-ae88cc2d3d76 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047579 Jul 20 21:59:18.680913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 406/849] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 21:59:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:19.978965 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2115414177", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0780df8c-47a0-412c-9735-300eea6eaf13"}], "security_groups": [{"name": "tempest-securitygroup--2051519486"}], "key_name": "tempest-keypair-1146868970", "user_data": "}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:20.087800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] validate_networks() for [('0780df8c-47a0-412c-9735-300eea6eaf13', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 21:59:20.484951 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 21:59:20.485385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 21:59:20.485860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 21:59:20.486269 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 21:59:20.486682 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 21:59:20.495959 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:20.496408 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:20.497208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:20.497647 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:20.516440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for project e722bb68652c48f588d8b53351c6f2a6. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 21:59:20.520403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Getting quotas for user 60f7f43c067e4b819aeb488e9f09197a and project e722bb68652c48f588d8b53351c6f2a6. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 21:59:20.531971 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 21:59:20.534236 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 21:59:20.581509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-aa24d371-60b4-414a-b7ea-4d7026f79e8d tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607313 Jul 20 21:59:20.582156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 444/850] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 21:59:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 21:59:20.593572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4328ef6e-ecfa-4836-a7d5-c526a5badbe4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:20.594442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4328ef6e-ecfa-4836-a7d5-c526a5badbe4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:20.652550 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4328ef6e-ecfa-4836-a7d5-c526a5badbe4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:20.660613 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4328ef6e-ecfa-4836-a7d5-c526a5badbe4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1238 microversion: 2.1 time: 0.071471 Jul 20 21:59:20.661182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 407/851] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:20 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:21.193345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:21.193922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:21.201254 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.201697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.202461 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.202892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.231606 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:59:21.266054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:21.310696 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6fd0abd0-9414-4147-9b16-c39f3d60713d tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 204 len: 0 microversion: 2.1 time: 0.122700 Jul 20 21:59:21.311558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 445/852] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:59:21 2022] DELETE /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:59:21.319764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:21.320370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:21.327082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.327538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.328295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.328726 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.466695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:21.474263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-af6e2010-0f65-4fe8-9973-480279a5acf3 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1507 microversion: 2.1 time: 0.158408 Jul 20 21:59:21.474843 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 408/853] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:21 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:21.677492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:21.678111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:21.684727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.685196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.685968 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:21.686405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:21.755557 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:21.763930 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-00ebb50f-4526-491a-9850-a6488c801e33 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1298 microversion: 2.1 time: 0.090821 Jul 20 21:59:21.764499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 446/854] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:21 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:22.493278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:22.494047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:22.500816 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:22.501259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:22.502022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:22.502596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:22.773786 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:22.781302 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-26faaac6-b488-4220-9d3b-ffe742d4563a tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1507 microversion: 2.1 time: 0.292849 Jul 20 21:59:22.781884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 409/855] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:22 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:22.789173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:22.790854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:22.797515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:22.798053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:22.798830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:22.799301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:22.881714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:22.890529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-77949b05-b54f-476b-a551-c16f39613542 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1296 microversion: 2.1 time: 0.105183 Jul 20 21:59:22.891130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 447/856] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:22 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:23.525088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-ad7ef277-3375-4526-84f4-67ba81a380bf req-84d7dfad-c86a-4be8-874e-e42fbca4bb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d0a71d-30e3-4ae7-9d30-76cf661b37ad", "name": "network-vif-deleted", "tag": "f62b1e8c-e6cf-4283-835b-52bdd104f80f"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:23.533609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:23.541247 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ad7ef277-3375-4526-84f4-67ba81a380bf req-84d7dfad-c86a-4be8-874e-e42fbca4bb5b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.542498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ad7ef277-3375-4526-84f4-67ba81a380bf req-84d7dfad-c86a-4be8-874e-e42fbca4bb5b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:23.560140 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-ad7ef277-3375-4526-84f4-67ba81a380bf req-84d7dfad-c86a-4be8-874e-e42fbca4bb5b service nova] Creating event network-vif-deleted:f62b1e8c-e6cf-4283-835b-52bdd104f80f for instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad on hv-cinder-84969 Jul 20 21:59:23.567310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-ad7ef277-3375-4526-84f4-67ba81a380bf req-84d7dfad-c86a-4be8-874e-e42fbca4bb5b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046261 Jul 20 21:59:23.568183 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 410/857] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:23.797991 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:23.798777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:23.806051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.806641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:23.807769 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.808281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:23.841814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.842850 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:23.843649 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'fault' on Instance uuid a0d0a71d-30e3-4ae7-9d30-76cf661b37ad {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:59:23.900874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:23.908886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:23.909102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bc595399-fb77-4325-b97d-cc79cbca82e7 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 200 len: 1311 microversion: 2.1 time: 0.114994 Jul 20 21:59:23.909723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 448/858] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:23 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:23.924914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:23.932610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.933055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:23.934209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:23.934754 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:24.420656 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:24.428812 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a2697f02-d393-4806-aa7d-90054a9c1fd2 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.524789 Jul 20 21:59:24.429404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 411/859] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:23 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:24.926742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:24.927389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: a0d0a71d-30e3-4ae7-9d30-76cf661b37ad] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:24.934161 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:24.934594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:24.935419 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:24.935859 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:24.949594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] HTTP exception thrown: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Request method failure captured: Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad HTTP/1.1 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk6rdg9RgXTwJ4yevFyc3pHFPX4zPiiCC8ZK0Y8Rr_6nca1sdd-TXSJWznYPm2PhbvMRrBgJ7BfLGdS8f3tlvKSsU44by5miUt1w4ySdqLYYmFR373GWJ8kWQyt-Gty7rF4rBS3AnUmxsWqin4j5RcqWQghoar5cdQTNi4dVlqEGW4 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:59:24.951273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_80320a3595ce4d4cb7c468b0fbec6580", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}] Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 1a0d4ce0ac4d47c8a184ea0291461379 Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. Jul 20 21:59:24.952788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'a0d0a71d-30e3-4ae7-9d30-76cf661b37ad'} Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:59:24.953713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. Jul 20 21:59:24.955118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:24.956455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Returning 404 to user: Instance a0d0a71d-30e3-4ae7-9d30-76cf661b37ad could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:59:24.956455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6e01f363-6d21-4e1f-91aa-9d98013628fd tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad" status: 404 len: 111 microversion: 2.1 time: 0.029857 Jul 20 21:59:24.956455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 449/860] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:24 2022] GET /compute/v2.1/servers/a0d0a71d-30e3-4ae7-9d30-76cf661b37ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:59:24.963572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:24.964152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:24.970646 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:24.971186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:24.971941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:24.972378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:24.998161 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 21:59:25.074565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a3845210-f218-4420-8b9c-17b083763362 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "DELETE /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 204 len: 0 microversion: 2.1 time: 0.116144 Jul 20 21:59:25.075288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 412/861] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 21:59:24 2022] DELETE /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 21:59:25.083478 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:25.084156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:25.091411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:25.091871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:25.092639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:25.093077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:25.225758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:25.233433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d25bd859-f991-4293-b9e4-b34637707ed0 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.153851 Jul 20 21:59:25.234003 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 450/862] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:25 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:25.447126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:25.447836 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:25.453893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:25.454345 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:25.455172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:25.455683 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:25.589109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-eb667002-651c-4f83-b243-662d0bd47f16 req-8260bb9c-d7b2-47c3-9732-1591c1e7364a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f8671a-1999-43cf-a51f-cc7ffb88f398", "tag": "e789d28d-85bd-42ee-80f5-d5005b709b15"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:25.596104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:25.597187 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-eb667002-651c-4f83-b243-662d0bd47f16 req-8260bb9c-d7b2-47c3-9732-1591c1e7364a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:25.597637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-eb667002-651c-4f83-b243-662d0bd47f16 req-8260bb9c-d7b2-47c3-9732-1591c1e7364a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:25.607626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-885d3897-5479-46b6-943e-a33d1f017c03 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.165219 Jul 20 21:59:25.608483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 413/863] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:25 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:25.617094 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-eb667002-651c-4f83-b243-662d0bd47f16 req-8260bb9c-d7b2-47c3-9732-1591c1e7364a service nova] Creating event network-changed:e789d28d-85bd-42ee-80f5-d5005b709b15 for instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 on hv-cinder-84969 Jul 20 21:59:25.617094 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-eb667002-651c-4f83-b243-662d0bd47f16 req-8260bb9c-d7b2-47c3-9732-1591c1e7364a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029364 Jul 20 21:59:25.617094 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 451/864] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:59:26.250702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:26.251347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:26.258086 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:26.259243 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:26.260120 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:26.260592 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:26.264986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:26.426162 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:26.442240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6d04de0b-0036-4be3-9a39-a1657b6e26df tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.195433 Jul 20 21:59:26.443128 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 414/865] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:26 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:26.626193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:26.626793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:26.633955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:26.634579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:26.635378 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:26.635807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:26.768391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:26.776531 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0104f12e-cad9-4d5a-8657-ff6fd80b7610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.155459 Jul 20 21:59:26.777098 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 452/866] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:26 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:27.459323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:27.459943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:27.467270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:27.467794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:27.468558 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:27.469176 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:27.776168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:27.784159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9b08fd27-4870-4dbd-8cd1-d4b9c43c57b5 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.328657 Jul 20 21:59:27.784741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 415/867] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:27 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:27.794127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:27.794744 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:27.801363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:27.801814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:27.802581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:27.803017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:27.938437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:27.946717 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-240415c2-fcf8-4851-a833-2e460e748af5 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.156982 Jul 20 21:59:27.947419 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 453/868] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:27 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:28.801579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:28.802180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:28.809537 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:28.809993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:28.810762 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:28.811236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:28.947189 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:28.955462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-66563a40-f9ef-4080-9b3f-a4bbd1ae60e1 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.157542 Jul 20 21:59:28.956011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 416/869] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:28 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:28.964231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:28.964967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:28.971770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:28.972221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:28.972986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:28.973422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:29.111800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:29.124207 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e53cf0ed-e80e-42c8-b929-e083fdf4bca0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.163426 Jul 20 21:59:29.125087 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 454/870] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:28 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:29.321828 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-2f034b94-e7ea-4b2c-9a58-a632ccb58653 req-0583c043-55ee-401c-a3b1-3e1d09c47d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f8671a-1999-43cf-a51f-cc7ffb88f398", "name": "network-vif-plugged", "status": "completed", "tag": "e789d28d-85bd-42ee-80f5-d5005b709b15"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:29.330079 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-2f034b94-e7ea-4b2c-9a58-a632ccb58653 req-0583c043-55ee-401c-a3b1-3e1d09c47d5b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:29.330562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-2f034b94-e7ea-4b2c-9a58-a632ccb58653 req-0583c043-55ee-401c-a3b1-3e1d09c47d5b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:29.343515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-2f034b94-e7ea-4b2c-9a58-a632ccb58653 req-0583c043-55ee-401c-a3b1-3e1d09c47d5b service nova] Creating event network-vif-plugged:e789d28d-85bd-42ee-80f5-d5005b709b15 for instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 on hv-cinder-84969 Jul 20 21:59:29.348215 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-2f034b94-e7ea-4b2c-9a58-a632ccb58653 req-0583c043-55ee-401c-a3b1-3e1d09c47d5b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030177 Jul 20 21:59:29.348817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 417/871] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 21:59:29.972975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:29.973585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:29.980656 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:29.981104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:29.981862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:29.982297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:30.113771 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:30.122575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9dce111b-9eea-4765-ab79-3c135cff4172 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1520 microversion: 2.1 time: 0.153488 Jul 20 21:59:30.123173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 455/872] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:29 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:30.148005 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:30.149200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:30.155508 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:30.155953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:30.156713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:30.157143 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:30.357558 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:30.365238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a83f7140-a25d-4710-9924-3d2c927e626b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.221867 Jul 20 21:59:30.365926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 418/873] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:30 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:30.878526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-722d5251-6c6f-4d3d-b2cf-7c41f5baa34e req-9e662e5d-6583-4769-a225-562866b71410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ae5df2-b95e-4408-94a0-c75f87543061", "name": "network-vif-deleted", "tag": "dade829a-03be-4cdc-9c12-e945626cdbe0"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:30.882043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:30.882703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=6 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:30.889582 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-722d5251-6c6f-4d3d-b2cf-7c41f5baa34e req-9e662e5d-6583-4769-a225-562866b71410 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:30.890024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-722d5251-6c6f-4d3d-b2cf-7c41f5baa34e req-9e662e5d-6583-4769-a225-562866b71410 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:30.901353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-722d5251-6c6f-4d3d-b2cf-7c41f5baa34e req-9e662e5d-6583-4769-a225-562866b71410 service nova] Creating event network-vif-deleted:dade829a-03be-4cdc-9c12-e945626cdbe0 for instance 18ae5df2-b95e-4408-94a0-c75f87543061 on hv-cinder-84969 Jul 20 21:59:30.906279 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-722d5251-6c6f-4d3d-b2cf-7c41f5baa34e req-9e662e5d-6583-4769-a225-562866b71410 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031360 Jul 20 21:59:30.906867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 456/874] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:31.140221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:31.140888 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:31.146538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:31.150412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:31.154246 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:31.156287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:31.157424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:31.235325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:31.245116 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6bf2b753-fc60-474a-afd8-ab6f8626f733 tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1306 microversion: 2.1 time: 0.108737 Jul 20 21:59:31.245701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 419/875] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:31 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 21:59:31.383860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:31.385151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:31.391889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:31.392393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:31.393191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:31.393618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:31.527747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:31.535193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0c650044-442e-4312-b0e4-c5a0e4741694 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1364 microversion: 2.1 time: 0.156178 Jul 20 21:59:31.535756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 457/876] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:31 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:32.262711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:32.263714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:32.270825 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.271303 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.272063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.272494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.307638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.308087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.308529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lazy-loading 'fault' on Instance uuid 18ae5df2-b95e-4408-94a0-c75f87543061 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 21:59:32.354509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0d4ce0ac4d47c8a184ea0291461379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320a3595ce4d4cb7c468b0fbec6580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:32.361963 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e173ab7f-84c2-449d-8dfe-44b3ec8de73f tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 200 len: 1311 microversion: 2.1 time: 0.103712 Jul 20 21:59:32.362521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 420/877] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:32 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:32.552562 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:32.553326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:32.560461 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.560906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.561673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.562107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.698407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 21:59:32.707600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-af295bbb-26a4-49e5-a158-a4eda0302a77 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1549 microversion: 2.1 time: 0.158804 Jul 20 21:59:32.719282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 458/878] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:32 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 21:59:32.725122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:32.725614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:32.732186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.732629 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.733395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:32.733829 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:32.823072 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-178710ab-21a0-4cf3-af93-7b5edab6e9ed tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101739 Jul 20 21:59:32.823666 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 421/879] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 21:59:32 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:33.379950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:33.380589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] [instance: 18ae5df2-b95e-4408-94a0-c75f87543061] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:33.387688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:33.388132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:33.388929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:33.389362 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:33.402797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] HTTP exception thrown: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Request method failure captured: Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 HTTP/1.1 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk6rdg9RgXTwJ4yevFyc3pHFPX4zPiiCC8ZK0Y8Rr_6nca1sdd-TXSJWznYPm2PhbvMRrBgJ7BfLGdS8f3tlvKSsU44by5miUt1w4ySdqLYYmFR373GWJ8kWQyt-Gty7rF4rBS3AnUmxsWqin4j5RcqWQghoar5cdQTNi4dVlqEGW4 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 21:59:33.404492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_80320a3595ce4d4cb7c468b0fbec6580", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/80320a3595ce4d4cb7c468b0fbec6580"}]}] Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 80320a3595ce4d4cb7c468b0fbec6580 Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-139351308 Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 1a0d4ce0ac4d47c8a184ea0291461379 Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-139351308-project Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. Jul 20 21:59:33.406245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '18ae5df2-b95e-4408-94a0-c75f87543061'} Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 21:59:33.408146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. Jul 20 21:59:33.411650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 21:59:33.414592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] Returning 404 to user: Instance 18ae5df2-b95e-4408-94a0-c75f87543061 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 21:59:33.414592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d0264220-4856-4189-b9ec-cf1e1c2ea4bf tempest-ServerRescueNegativeTestJSON-139351308 tempest-ServerRescueNegativeTestJSON-139351308-project] 10.222.0.86 "GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061" status: 404 len: 111 microversion: 2.1 time: 0.030134 Jul 20 21:59:33.414592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 459/880] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 21:59:33 2022] GET /compute/v2.1/servers/18ae5df2-b95e-4408-94a0-c75f87543061 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 21:59:33.888209 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-c5153f67-ec13-49d5-8e05-fc91486c3e49 req-e7fc851f-6682-4ec5-88ff-a94c87a8e82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f8671a-1999-43cf-a51f-cc7ffb88f398", "tag": "e789d28d-85bd-42ee-80f5-d5005b709b15"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:33.901062 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c5153f67-ec13-49d5-8e05-fc91486c3e49 req-e7fc851f-6682-4ec5-88ff-a94c87a8e82e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:33.902273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c5153f67-ec13-49d5-8e05-fc91486c3e49 req-e7fc851f-6682-4ec5-88ff-a94c87a8e82e service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:33.936889 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-c5153f67-ec13-49d5-8e05-fc91486c3e49 req-e7fc851f-6682-4ec5-88ff-a94c87a8e82e service nova] Creating event network-changed:e789d28d-85bd-42ee-80f5-d5005b709b15 for instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 on hv-cinder-84969 Jul 20 21:59:33.949827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-c5153f67-ec13-49d5-8e05-fc91486c3e49 req-e7fc851f-6682-4ec5-88ff-a94c87a8e82e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064592 Jul 20 21:59:33.956731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 422/881] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:57.400747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-117113324"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:57.401932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:57.404120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:57.404772 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:57.410787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:57.411251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:57.412209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:57.412647 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:57.578106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.network.security_group_api [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Removing security group 8ae75024-ef2d-49d3-884f-90adec236a1b from port af8e0902-594b-48c4-ae9f-5f18ed045896 Jul 20 21:59:58.278718 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6c1f739e-6bb3-4375-93bd-73a4458390ec tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action" status: 202 len: 0 microversion: 2.1 time: 0.882613 Jul 20 21:59:58.283492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 460/882] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 21:59:57 2022] POST /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 21:59:58.301834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:58.302553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=44 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:59:58.307049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-bc47ff32-bd4f-4d23-a654-2a636f38df34 req-002f173b-04ed-44d0-8d4d-6ca6cf4ce48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 21:59:58.337109 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-bc47ff32-bd4f-4d23-a654-2a636f38df34 req-002f173b-04ed-44d0-8d4d-6ca6cf4ce48c service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:58.338497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-bc47ff32-bd4f-4d23-a654-2a636f38df34 req-002f173b-04ed-44d0-8d4d-6ca6cf4ce48c service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:58.359037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-bc47ff32-bd4f-4d23-a654-2a636f38df34 req-002f173b-04ed-44d0-8d4d-6ca6cf4ce48c service nova] Creating event network-changed:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 21:59:58.369088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-bc47ff32-bd4f-4d23-a654-2a636f38df34 req-002f173b-04ed-44d0-8d4d-6ca6cf4ce48c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068685 Jul 20 21:59:58.374543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 423/883] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 21:59:59.880385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 21:59:59.881411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 21:59:59.889847 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:59.890467 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 21:59:59.891448 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 21:59:59.892052 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:00.003273 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lazy-loading 'services' on Instance uuid be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:00:00.332401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-37eb55c1-612b-45a0-87f8-43fc5df540f4 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments/2791370e-706a-4259-b539-8a42b8cc1550" status: 202 len: 0 microversion: 2.1 time: 0.456397 Jul 20 22:00:00.333229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 461/884] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 21:59:59 2022] DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments/2791370e-706a-4259-b539-8a42b8cc1550 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:00:00.343566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:00.344515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:00.354728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:00.355509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:00.356487 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:00.357505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:00.391601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-26b59818-55b6-41b5-bd21-ff737b949671 req-f0117d6b-18b3-4f23-9247-4c449df795bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:00.394255 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bca16df9-5640-46a4-89e5-c3d55a89bc42 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055189 Jul 20 22:00:00.399100 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 424/885] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:00 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:00.411998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-26b59818-55b6-41b5-bd21-ff737b949671 req-f0117d6b-18b3-4f23-9247-4c449df795bb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:00.412609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-26b59818-55b6-41b5-bd21-ff737b949671 req-f0117d6b-18b3-4f23-9247-4c449df795bb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:00.428264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-26b59818-55b6-41b5-bd21-ff737b949671 req-f0117d6b-18b3-4f23-9247-4c449df795bb service nova] Creating event network-changed:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 22:00:00.444509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-26b59818-55b6-41b5-bd21-ff737b949671 req-f0117d6b-18b3-4f23-9247-4c449df795bb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057411 Jul 20 22:00:00.445844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 462/886] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:00:01.407592 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:01.408534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:01.420618 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:01.421061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:01.421861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:01.425698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:01.535369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2cc9290e-693c-46ee-a4fe-2b4b3aaadc9b tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132712 Jul 20 22:00:01.539361 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 425/887] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:01 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:02.548852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:02.549878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:02.562980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:02.563443 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:02.564627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:02.564627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:02.612397 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-12b89d74-e243-4e7e-b0b5-16f771e98463 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067515 Jul 20 22:00:02.622951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:02.623791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:02.628054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 463/888] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:02 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 22:00:02.630831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:02.631400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:02.632257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:02.632824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:02.739561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] HTTP exception thrown: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e is not attached to volume 2791370e-706a-4259-b539-8a42b8cc1550 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Request method failure captured: Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments/2791370e-706a-4259-b539-8a42b8cc1550 HTTP/1.1 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2HnyJCcZli8ASdQ52zGRL_c_F0sydHc6Y9dBEwa63c0Spt05bOA4eAEIZ-Vcl-G5Xs01Nz9ukEb86F8fJ-MO0lZSyt8mRhS9ieou15dukIxnr1qnwYiynBXNE3cJ1iTi5scmvtMEh_hiZSiGm59OZZF3rFN3d4nU_9nZ-nVcE7uIKQA Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: c17214008914495b8083b74c6fc9e405 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:00:02.744298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c17214008914495b8083b74c6fc9e405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c17214008914495b8083b74c6fc9e405", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c17214008914495b8083b74c6fc9e405"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c17214008914495b8083b74c6fc9e405"}]}] Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: c17214008914495b8083b74c6fc9e405 Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-TestMinimumBasicScenario-596458590-project Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 030fcf8f4e654d08ac9c7e5dcb3eddd9 Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-TestMinimumBasicScenario-596458590-project Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:00:02.745985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e is not attached to volume 2791370e-706a-4259-b539-8a42b8cc1550 Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'server_id': 'be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e', 'id': '2791370e-706a-4259-b539-8a42b8cc1550'} Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2791370e-706a-4259-b539-8a42b8cc1550. Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:00:02.746904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e is not attached to volume 2791370e-706a-4259-b539-8a42b8cc1550 Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e is not attached to volume 2791370e-706a-4259-b539-8a42b8cc1550 Jul 20 22:00:02.748471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:02.749772 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Returning 404 to user: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e is not attached to volume 2791370e-706a-4259-b539-8a42b8cc1550 {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:00:02.751795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0a317e0d-7578-4235-a7a3-9894de44bf84 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments/2791370e-706a-4259-b539-8a42b8cc1550" status: 404 len: 154 microversion: 2.1 time: 0.132347 Jul 20 22:00:02.752949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 426/889] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:00:02 2022] DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e/os-volume_attachments/2791370e-706a-4259-b539-8a42b8cc1550 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:00:03.913817 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:03.914607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:03.922409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:03.923369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:03.924567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:03.925226 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:03.956854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:00:04.075962 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3090806d-5efb-423a-88ad-c4b08c6aed03 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 204 len: 0 microversion: 2.1 time: 0.166375 Jul 20 22:00:04.077455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 464/890] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:00:03 2022] DELETE /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:00:04.088497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:04.089265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:04.102565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:04.103287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:04.114488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:04.115037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:04.364389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:04.377284 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-546fd957-bfbe-4dab-9ddd-32fac64e2ef9 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1553 microversion: 2.1 time: 0.293397 Jul 20 22:00:04.388644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 427/891] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:04 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:05.408470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:05.410459 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:05.435724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:05.436477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:05.437617 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:05.438266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:05.648359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:05.658684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-73166e01-59ec-42b8-853d-e901c9061fa0 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1553 microversion: 2.1 time: 0.264925 Jul 20 22:00:05.659615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 465/892] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:05 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:06.684628 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:06.692701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:06.702050 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:06.702716 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:06.703904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:06.704519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:06.987489 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:06.998598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3771fac8-b864-4c21-a111-9e1ee147c678 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1553 microversion: 2.1 time: 0.325517 Jul 20 22:00:07.002764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 428/893] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:06 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:08.019081 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:08.021719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:08.034063 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:08.035549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:08.037148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:08.038169 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:08.442192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030fcf8f4e654d08ac9c7e5dcb3eddd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17214008914495b8083b74c6fc9e405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:08.456575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c99cd336-b658-4409-81ca-e1e6d304f836 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 200 len: 1553 microversion: 2.1 time: 0.443716 Jul 20 22:00:08.458208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 466/894] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:08 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:08.474061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-dff3599e-5151-4c12-a8af-9c1e2b1f97e7 req-6ab303cc-94f0-4a62-bc9f-8b2cdf038978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e", "name": "network-vif-deleted", "tag": "af8e0902-594b-48c4-ae9f-5f18ed045896"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:08.519674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-dff3599e-5151-4c12-a8af-9c1e2b1f97e7 req-6ab303cc-94f0-4a62-bc9f-8b2cdf038978 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:08.521291 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-dff3599e-5151-4c12-a8af-9c1e2b1f97e7 req-6ab303cc-94f0-4a62-bc9f-8b2cdf038978 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:08.562392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-dff3599e-5151-4c12-a8af-9c1e2b1f97e7 req-6ab303cc-94f0-4a62-bc9f-8b2cdf038978 service nova] Creating event network-vif-deleted:af8e0902-594b-48c4-ae9f-5f18ed045896 for instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e on hv-cinder-84969 Jul 20 22:00:08.578405 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-dff3599e-5151-4c12-a8af-9c1e2b1f97e7 req-6ab303cc-94f0-4a62-bc9f-8b2cdf038978 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128065 Jul 20 22:00:08.580332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 429/895] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:09.474530 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:09.475164 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] [instance: be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:09.482535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:09.482979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:09.483782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:09.484229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:09.498233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] HTTP exception thrown: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Request method failure captured: Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e HTTP/1.1 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HnyJCcZli8ASdQ52zGRL_c_F0sydHc6Y9dBEwa63c0Spt05bOA4eAEIZ-Vcl-G5Xs01Nz9ukEb86F8fJ-MO0lZSyt8mRhS9ieou15dukIxnr1qnwYiynBXNE3cJ1iTi5scmvtMEh_hiZSiGm59OZZF3rFN3d4nU_9nZ-nVcE7uIKQA Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: c17214008914495b8083b74c6fc9e405 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:00:09.500284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c17214008914495b8083b74c6fc9e405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c17214008914495b8083b74c6fc9e405", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c17214008914495b8083b74c6fc9e405"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c17214008914495b8083b74c6fc9e405"}]}] Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: c17214008914495b8083b74c6fc9e405 Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-TestMinimumBasicScenario-596458590 Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-TestMinimumBasicScenario-596458590-project Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 030fcf8f4e654d08ac9c7e5dcb3eddd9 Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-TestMinimumBasicScenario-596458590-project Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. Jul 20 22:00:09.501837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e'} Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:00:09.502605 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. Jul 20 22:00:09.504074 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:09.505699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Returning 404 to user: Instance be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:00:09.505699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8f6b3f60-cdb7-496b-add3-e95d968cbf51 tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e" status: 404 len: 111 microversion: 2.1 time: 0.030955 Jul 20 22:00:09.505699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 467/896] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:09 2022] GET /compute/v2.1/servers/be2c064d-e2fe-4c67-9bcc-58cd1b95ed3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:00:09.512051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5d26b41c-3a3c-46b0-ab19-701f5f8fda8a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] Calling method '.version_select at 0x7f6aba6f3280>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:09.532732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5d26b41c-3a3c-46b0-ab19-701f5f8fda8a tempest-TestMinimumBasicScenario-596458590 tempest-TestMinimumBasicScenario-596458590-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-369258151" status: 202 len: 0 microversion: 2.1 time: 0.025678 Jul 20 22:00:09.533325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 430/897] 10.222.0.86 () {58 vars in 1268 bytes} [Wed Jul 20 22:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-369258151 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:00:09.750728 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-75d5d487-9b01-4178-99a4-f863b4c003c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Action: 'create', calling method: .version_select at 0x7f6aba4b1310>, body: {"keypair": {"name": "tempest-TestShelveInstance-815779289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY0zNf4fcFGZPVXpiFxFaLc77zzM7vQ2tV7TZ7VTj7qbbT9RdtIaIfOp0v/+zyU6OEc7br60OAiQkI3THsFsZBUBvEAurBwrQ4pEJ/pL4XH/7auveHcPDTVUg/dM5ow+A=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:09.765338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-75d5d487-9b01-4178-99a4-f863b4c003c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Getting quotas for project 2f83ca7e7fc844f180ae057a576f3723. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:00:09.769352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-75d5d487-9b01-4178-99a4-f863b4c003c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Getting quotas for user 24c9257cf9254b82a2b9fa5ee41243be and project 2f83ca7e7fc844f180ae057a576f3723. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:00:09.794246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-75d5d487-9b01-4178-99a4-f863b4c003c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.227392 Jul 20 22:00:09.794969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 468/898] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 22:00:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:11.478134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:11.479993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:11.489623 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:11.490298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:11.491239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:11.492107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:11.526778 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0dc7a6c1-2c35-4f3f-8956-4b83ec7aaa52 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/ips" status: 200 len: 151 microversion: 2.20 time: 0.054643 Jul 20 22:00:11.528147 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 431/899] 10.222.0.86 () {60 vars in 1288 bytes} [Wed Jul 20 22:00:11 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:00:13.917955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:13.919811 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:13.938213 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:13.939513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:13.940351 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:13.940790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:13.966865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lazy-loading 'flavor' on Instance uuid f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:00:14.366558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6ee487b0-42d3-48a6-929e-833f0a019fe0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/action" status: 202 len: 0 microversion: 2.20 time: 0.455916 Jul 20 22:00:14.368153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 469/900] 10.222.0.86 () {62 vars in 1318 bytes} [Wed Jul 20 22:00:13 2022] POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 22:00:14.383568 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:14.385979 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:14.395196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:14.395990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:14.397272 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:14.397863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:14.648938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:14.648938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:14.656740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:14.657227 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:14.658067 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:14.659570 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:14.670955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:14.680417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:14.682628 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:14.683886 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cdab1f19-44a3-418b-9eaf-295a21da54d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.310335 Jul 20 22:00:14.685129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 432/901] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:14 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:14.692139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-81cf16f9-15ca-4142-a715-4d33c270f948 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/ips" status: 200 len: 151 microversion: 2.1 time: 0.052133 Jul 20 22:00:14.692139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 470/902] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 22:00:14 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:00:15.703501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:15.704171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:15.710907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:15.711469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:15.712997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:15.713582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:15.943237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:15.952362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:15.953941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:15.955070 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0ec49759-e341-4a06-8a03-c44c205644d4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.255760 Jul 20 22:00:15.955641 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 433/903] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:15 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:16.105799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:16.108414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:16.117305 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:16.117852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:16.118888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:16.119593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:16.441589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6c6f1d20-c50b-4e6e-abc9-8d70a55b0776 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343271 Jul 20 22:00:16.443786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 471/904] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:00:16 2022] POST /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:16.980934 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:16.981945 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:16.996370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:16.997148 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:16.998597 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:16.999431 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:17.196980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:17.206041 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:17.209301 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:17.211466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0de21ccd-d2ce-49d5-88c9-b86c4e063989 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.239565 Jul 20 22:00:17.213056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 434/905] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:16 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:18.231453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:18.232253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:18.239694 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:18.240151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:18.240938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:18.241376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:18.393053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:18.402083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:18.403644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:18.404823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-929ebd36-53b0-4db6-adfd-dc19cb6854cb tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.178842 Jul 20 22:00:18.405391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 472/906] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:18 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:19.430837 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:19.432761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:19.439584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:19.440047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:19.440842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:19.441290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:19.587590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:19.595816 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:19.597330 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:19.598514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f131d743-df06-437e-a921-51cc39992ae7 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.171840 Jul 20 22:00:19.599090 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 435/907] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:19 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:20.616907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:20.617436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:20.620390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:20.626028 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:20.626477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:20.627266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:20.627700 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:20.763697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:20.767253 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:20.772698 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:20.774202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:20.775562 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1ab66752-3ae2-4c2e-82f8-8df90057a5c3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.162645 Jul 20 22:00:20.776113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 473/908] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:20 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:21.793906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:21.794701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:21.801265 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:21.801730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:21.802516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:21.802959 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:21.955014 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:21.969171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:21.972195 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:21.974395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b62de49b-950f-426e-8848-28975d8922de tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.184294 Jul 20 22:00:21.975440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 436/909] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:21 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:23.003545 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:23.005935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:23.014023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:23.014475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:23.015276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:23.015713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:23.173227 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:23.182530 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:23.184341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:23.185526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a8e341bb-9898-4ef4-8a57-f5d142f1fcb4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.187023 Jul 20 22:00:23.186406 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 474/910] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:22 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:24.008410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:24.009609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:24.016543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.016993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.017756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.018192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.099517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: POST /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments HTTP/1.1 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 74 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:00:24.101218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {"volumeAttachment": {"volumeId": "a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73"}} Jul 20 22:00:24.103474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'server_id': 'f20c7cdc-854d-4d66-91d9-6b6da979ee15', 'body': {'volumeAttachment': {'volumeId': 'a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73'}}} Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:24.104636 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:24.106032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 400 to user: Invalid volume: volume a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 is already attached to instances: f20c7cdc-854d-4d66-91d9-6b6da979ee15 {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-29ab7347-1d8a-4c36-93a3-4aa7aab32738 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099075 Jul 20 22:00:24.107790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 437/911] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:00:24 2022] POST /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:00:24.169795 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:24.170373 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:24.176919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.177375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.178158 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.178591 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.204907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:24.205684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:24.213057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.213519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.214351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.214749 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.263862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'services' on Instance uuid f20c7cdc-854d-4d66-91d9-6b6da979ee15 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:00:24.340344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ff692b72-fdd4-4410-afcd-04cbc61eef1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments/a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73" status: 202 len: 0 microversion: 2.1 time: 0.174874 Jul 20 22:00:24.340969 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 475/912] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:00:24 2022] DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments/a7e8a581-bc1e-46fe-bf18-1f5d31ca2c73 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:00:24.349803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:24.351609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:24.352336 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:24.359332 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:24.360193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.360679 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.361491 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:24.361621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:24.362142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:24.362436 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ee1f44d9-918f-4ab8-b0e4-d1318b570163 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.161381 Jul 20 22:00:24.372398 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 438/913] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:24 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:24.395830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e7583660-4cf2-4797-982f-dfcf730689f0 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050133 Jul 20 22:00:24.396407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 476/914] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:24 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:25.382234 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:25.382838 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:25.389585 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.390049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.390829 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.391306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.408792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:25.409699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:25.416203 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.416632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.417402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.417830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.448314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-72203bb3-a983-4dcc-8fdf-987691621b5d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043530 Jul 20 22:00:25.448878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 477/915] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:25 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 22:00:25.507844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:25.509841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:25.516296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.516764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.517547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.518020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.531793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:25.539689 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:25.541830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:25.543001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-554759b6-85c4-4351-9091-3a3456fd983f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.165388 Jul 20 22:00:25.544440 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:00:25.544594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 439/916] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:25 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:25.632609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b05434b0-15f8-4621-ae1f-cf8fdaea6d6b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 204 len: 0 microversion: 2.1 time: 0.128273 Jul 20 22:00:25.633116 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 478/917] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:00:25 2022] DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 22:00:25.641470 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:25.642134 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:25.648168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.648626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.649423 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:25.649861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:25.783780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:25.792845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-215e51a7-6524-4508-bd9b-773fde940e5f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1682 microversion: 2.1 time: 0.155215 Jul 20 22:00:25.793415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 440/918] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:25 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:26.562921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:26.563659 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:26.570375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:26.570974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:26.573029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:26.573422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:26.710787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:26.718901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:26.720450 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:26.721603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bdb02d58-426f-42af-8086-cd8e1b4330d0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.162993 Jul 20 22:00:26.722157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 479/919] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:26 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:26.811430 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:26.811990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:26.818872 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:26.819353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:26.820122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:26.820554 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:26.960114 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:26.967922 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9eccc862-e663-474a-9e02-6d24b2be8ecf tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1682 microversion: 2.1 time: 0.160695 Jul 20 22:00:26.968503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 441/920] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:26 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:27.740338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:27.740980 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:27.743575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:27.749163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:27.749610 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:27.750654 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:27.751187 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:27.887730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:27.896908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:27.898549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:27.900461 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7abf7603-2436-4cb9-a0d0-226d032acdcf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.164205 Jul 20 22:00:27.901007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 480/921] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:27 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:27.985817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:27.986434 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:27.993600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:27.994060 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:27.994845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:27.995318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:27.999559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=100 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:28.134550 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:28.142464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-31ce25dc-e51c-42b8-a1ad-fd4c6eb5cd1b tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1682 microversion: 2.1 time: 0.160428 Jul 20 22:00:28.143033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 442/922] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:27 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:28.919341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:28.919904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:28.926673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:28.927167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:28.927947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:28.928390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:29.160424 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:29.161058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:29.164572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:29.169587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:29.169966 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:29.170743 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:29.171207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:29.202927 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:29.213398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:29.214909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:29.216107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-870c2695-c105-4fa2-8312-80151ef2e335 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.300827 Jul 20 22:00:29.216660 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 481/923] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:28 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:29.367581 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:29.376341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8456ee8b-cf1c-436b-b69a-937b8d861bbd tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1682 microversion: 2.1 time: 0.219926 Jul 20 22:00:29.376978 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 443/924] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:29 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:29.730775 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-dc1b6748-0023-42da-8879-3ee46c024313 req-96275c24-e4f6-4206-a2d3-d1db243b85af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20c7cdc-854d-4d66-91d9-6b6da979ee15", "name": "network-vif-deleted", "tag": "9e7ef3c5-d778-4021-abb1-a30bc2f284cc"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:29.740574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-dc1b6748-0023-42da-8879-3ee46c024313 req-96275c24-e4f6-4206-a2d3-d1db243b85af service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:29.741027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-dc1b6748-0023-42da-8879-3ee46c024313 req-96275c24-e4f6-4206-a2d3-d1db243b85af service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:29.754769 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-dc1b6748-0023-42da-8879-3ee46c024313 req-96275c24-e4f6-4206-a2d3-d1db243b85af service nova] Creating event network-vif-deleted:9e7ef3c5-d778-4021-abb1-a30bc2f284cc for instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 on hv-cinder-84969 Jul 20 22:00:29.762419 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-dc1b6748-0023-42da-8879-3ee46c024313 req-96275c24-e4f6-4206-a2d3-d1db243b85af service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035434 Jul 20 22:00:29.763466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 482/925] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:30.234978 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:30.235625 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:30.242241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:30.242695 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:30.244033 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:30.244477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:30.390119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:30.394499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:30.395838 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:30.400680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:30.402549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:30.403919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:30.404424 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:30.404556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-52c1ee6c-0c9d-49ce-8f91-0a9717a181b9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.173461 Jul 20 22:00:30.415758 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:30.415894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 444/926] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:30 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:30.415982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:30.443330 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:30.443920 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:30.444490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid f20c7cdc-854d-4d66-91d9-6b6da979ee15 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:00:30.491201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:30.499623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7d413c42-6197-4f65-b3b3-662e5f338202 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 200 len: 1330 microversion: 2.1 time: 0.109201 Jul 20 22:00:30.500774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 483/927] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:30 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:31.423982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:31.424516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:31.432124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:31.432578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:31.433346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:31.433783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:31.517333 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:31.518051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:31.526250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:31.526753 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:31.528574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:31.529383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:31.544918 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 HTTP/1.1 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:00:31.546586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:00:31.547904 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'f20c7cdc-854d-4d66-91d9-6b6da979ee15'} Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:00:31.548662 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:00:31.549874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:00:31.551458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:00:31.551458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8830e754-c3e6-4ed9-b93e-f7062252b9c1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 404 len: 111 microversion: 2.1 time: 0.034873 Jul 20 22:00:31.551458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 484/928] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:31 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:00:31.559433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b1f92106-5978-4f0a-ae92-8be095d54a75 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '.version_select at 0x7f6aba4b1550>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:31.575668 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:31.577534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b1f92106-5978-4f0a-ae92-8be095d54a75 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376511447" status: 202 len: 0 microversion: 2.1 time: 0.023483 Jul 20 22:00:31.578108 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 485/929] 10.222.0.86 () {58 vars in 1217 bytes} [Wed Jul 20 22:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376511447 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:00:31.583950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:31.585469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:31.586699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-07464401-ad89-4d7d-87f5-746985ffe64d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.166690 Jul 20 22:00:31.587442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 445/930] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:31 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:32.208639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-aa3e3e44-3e61-45db-8941-b687ca1af66f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: .version_select at 0x7f6aba4dc1f0>, body: {"keypair": {"name": "tempest-keypair-1057766579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3oTfNwOB26SFBgpLhPur6FkPESqwpKtCb0UrKD7sZcJT5kjt8qqPmG9PqTKGQN24kBz1qFcMlYEQY4CzNjbt3C7hotn/0Cg1gtJfjjoqGwLxbfi7YSeECE0GhyRyFpMw=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:32.225409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-aa3e3e44-3e61-45db-8941-b687ca1af66f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:00:32.230231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-aa3e3e44-3e61-45db-8941-b687ca1af66f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:00:32.256221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-aa3e3e44-3e61-45db-8941-b687ca1af66f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051480 Jul 20 22:00:32.256830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 486/931] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 22:00:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:32.606104 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:32.606903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:32.613567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:32.614032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:32.614970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:32.615439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:32.780319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:32.788702 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:32.791481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:32.792705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2f25a2dd-a070-4829-894e-f099f5d22831 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.191767 Jul 20 22:00:32.793284 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 446/932] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:32 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:33.005360 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-407680016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-815779289", "security_groups": [{"name": "tempest-secgroup-smoke-307702454"}], "networks": [{"uuid": "2438b563-9ced-4a47-a015-31294a0faf56"}], "block_device_mapping_v2": [{"uuid": "1bfde0b2-eed9-4997-9422-960868205fa9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:33.139245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] validate_networks() for [('2438b563-9ced-4a47-a015-31294a0faf56', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:00:33.563435 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:00:33.563905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:00:33.565077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:00:33.565077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:00:33.565246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:00:33.574858 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:33.575329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:33.576172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:33.576607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:33.594761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Getting quotas for project 2f83ca7e7fc844f180ae057a576f3723. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:00:33.602348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Getting quotas for user 24c9257cf9254b82a2b9fa5ee41243be and project 2f83ca7e7fc844f180ae057a576f3723. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:00:33.662779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:00:33.665738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bfde0b2-eed9-4997-9422-960868205fa9',volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:00:33.670780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1567891541", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e24c0e-fc60-4c54-b80d-8c328d2228f9"}], "security_groups": [{"name": "tempest-securitygroup--1658647685"}], "key_name": "tempest-keypair-1057766579", "user_data": "}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:33.783008 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] validate_networks() for [('54e24c0e-fc60-4c54-b80d-8c328d2228f9', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:00:33.811198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-da0f903a-53ac-4841-8125-b733a0179355 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809155 Jul 20 22:00:33.815224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 487/933] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:00:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:00:33.821619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:33.823988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:33.833421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:33.833869 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:33.834631 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:33.835096 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:34.062160 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:34.077278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:34.078938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:34.080325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a4e95644-a6ad-4437-926b-a5e72e2eb5d5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.264094 Jul 20 22:00:34.084050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 488/934] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:33 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:34.089594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1c0b4957-0c1e-4cf7-bca1-89a4fcfbe4e7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:34.090502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1c0b4957-0c1e-4cf7-bca1-89a4fcfbe4e7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:34.179021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1c0b4957-0c1e-4cf7-bca1-89a4fcfbe4e7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:34.187095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1c0b4957-0c1e-4cf7-bca1-89a4fcfbe4e7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1087 microversion: 2.1 time: 0.101755 Jul 20 22:00:34.187926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 489/935] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:34 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1087 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:34.317073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:00:34.317808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:00:34.318383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:00:34.318865 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:00:34.319377 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:00:34.329307 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:34.330028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:34.330936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:34.331765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:34.349271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:00:34.354708 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Getting quotas for user c58389cb50e140d69f1d4c99d6d0e182 and project a41b592357304d8787cc8e1ab4c9df15. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:00:34.366984 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:00:34.370732 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:00:34.421681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6fa78be4-82b7-41b5-aab1-66924fc115ac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.755488 Jul 20 22:00:34.422546 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 447/936] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:00:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 22:00:34.433392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-68a59c24-b596-422b-aba8-64f111eac376 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:34.434340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-68a59c24-b596-422b-aba8-64f111eac376 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:34.513763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-68a59c24-b596-422b-aba8-64f111eac376 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:34.522208 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-68a59c24-b596-422b-aba8-64f111eac376 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1242 microversion: 2.1 time: 0.093605 Jul 20 22:00:34.539221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 490/937] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:34 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:35.105133 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:35.106372 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:35.114658 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.115146 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.116064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.116633 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.205576 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:35.207178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:35.215508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.215959 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.216928 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.217367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.326224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:35.338677 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7b49367c-aed0-475b-bfeb-7e46f2e0f677 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1203 microversion: 2.1 time: 0.137548 Jul 20 22:00:35.340241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 491/938] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:35 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1203 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:35.378849 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:35.389340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:35.391186 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:35.392378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1a4a43ec-d3ac-4f08-9fc7-ac19fa0f8215 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.294422 Jul 20 22:00:35.395093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 448/939] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:35 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:35.543753 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:35.544370 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:35.550400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.550849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.551648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:35.552072 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:35.641645 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:35.650511 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-68bbe67b-ee4d-4acc-af56-7e983b66f2b7 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1294 microversion: 2.1 time: 0.111599 Jul 20 22:00:35.651331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 492/940] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:35 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:36.357225 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:36.358943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:36.365130 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.365671 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.369827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.369827 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.411828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:36.412437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:36.420612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.420956 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.421734 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.422165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.794555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:36.802344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4daf95dc-ce24-466b-aae4-16ca6a6dcc57 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.449716 Jul 20 22:00:36.802939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 449/941] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:36 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:36.807693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:36.808304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:36.814608 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.815089 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.815870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:36.816310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:36.925590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:36.928730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:36.932893 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:36.934248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4f125daa-cb80-4173-b4ce-b35568c2022f tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1300 microversion: 2.1 time: 0.130143 Jul 20 22:00:36.934929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 450/942] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:36 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:36.949155 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:36.950666 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:36.951862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3f82d561-9d0c-4f41-a007-7b1021fe2e04 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1745 microversion: 2.20 time: 0.544702 Jul 20 22:00:36.952432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 493/943] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:36 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1745 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:37.721187 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-83836f9a-4648-413e-b366-e8fd939e67b6 req-2a4947f3-17e6-4f60-98cb-8ea6b32bf359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:37.748212 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-83836f9a-4648-413e-b366-e8fd939e67b6 req-2a4947f3-17e6-4f60-98cb-8ea6b32bf359 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:37.749080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-83836f9a-4648-413e-b366-e8fd939e67b6 req-2a4947f3-17e6-4f60-98cb-8ea6b32bf359 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:37.768765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-83836f9a-4648-413e-b366-e8fd939e67b6 req-2a4947f3-17e6-4f60-98cb-8ea6b32bf359 service nova] Creating event network-changed:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:00:37.777864 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-83836f9a-4648-413e-b366-e8fd939e67b6 req-2a4947f3-17e6-4f60-98cb-8ea6b32bf359 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066544 Jul 20 22:00:37.779604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 451/944] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:37.820603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:37.821477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:37.832756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:37.833323 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:37.834121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:37.834785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:37.957083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:37.959483 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:37.972930 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:37.973674 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:37.974671 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:37.975320 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:38.567844 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:38.576140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:38.584667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1e1471bf-b227-40f4-a4cd-3af2e5fe2a36 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.769994 Jul 20 22:00:38.586175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 494/945] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:37 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:38.593014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:38.594119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:38.600879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:38.601790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:38.603575 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:38.604272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:38.606365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e63a7bcc-04c0-4042-b5c3-7282cf01402d tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.653461 Jul 20 22:00:38.607227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 452/946] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:37 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:39.005493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:39.014689 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:39.017014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:39.018998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-eb5f7b38-b19d-426d-bf98-81c2000cfce9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.430655 Jul 20 22:00:39.021021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 495/947] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:38 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:39.606677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:39.607969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:39.616058 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:39.617013 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:39.618226 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:39.618830 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:39.630990 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:39.631714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:39.659674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:39.663756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:39.668352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:39.670233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.345403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:40.363569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7a063baa-de81-4820-9b89-b5dc2f83defa tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.739874 Jul 20 22:00:40.364428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 496/948] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:39 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:40.425507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-ad8cfdc9-7981-482a-bcb1-bff36643a548 req-ee6e6650-62ad-41cb-beea-cb760f15cf1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02dfe472-7b0f-4521-8b13-533f3e25c91f", "tag": "cf32e8b2-508a-42c8-931a-f87aedbe4980"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:40.425507 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-ad8cfdc9-7981-482a-bcb1-bff36643a548 req-ee6e6650-62ad-41cb-beea-cb760f15cf1b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.426700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:40.426905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-ad8cfdc9-7981-482a-bcb1-bff36643a548 req-ee6e6650-62ad-41cb-beea-cb760f15cf1b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.431843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-ad8cfdc9-7981-482a-bcb1-bff36643a548 req-ee6e6650-62ad-41cb-beea-cb760f15cf1b service nova] Creating event network-changed:cf32e8b2-508a-42c8-931a-f87aedbe4980 for instance 02dfe472-7b0f-4521-8b13-533f3e25c91f on hv-cinder-84969 Jul 20 22:00:40.434755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ef218f12-6a65-4c30-8241-335013cae429 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.833978 Jul 20 22:00:40.437672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-ad8cfdc9-7981-482a-bcb1-bff36643a548 req-ee6e6650-62ad-41cb-beea-cb760f15cf1b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059495 Jul 20 22:00:40.438470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 497/949] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:40.444592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-d0914f76-b70f-44fa-8a8d-2056ce98bc16 req-d90547af-fdc3-4e0c-9e79-48835aee0c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "name": "network-vif-plugged", "status": "completed", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:40.446648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 453/950] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:39 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:40.452063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:40.452682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:40.457667 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d0914f76-b70f-44fa-8a8d-2056ce98bc16 req-d90547af-fdc3-4e0c-9e79-48835aee0c7b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.458766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-d0914f76-b70f-44fa-8a8d-2056ce98bc16 req-d90547af-fdc3-4e0c-9e79-48835aee0c7b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.458962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.459471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.460259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.460704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.476571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-d0914f76-b70f-44fa-8a8d-2056ce98bc16 req-d90547af-fdc3-4e0c-9e79-48835aee0c7b service nova] Creating event network-vif-plugged:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 22:00:40.483870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-d0914f76-b70f-44fa-8a8d-2056ce98bc16 req-d90547af-fdc3-4e0c-9e79-48835aee0c7b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043464 Jul 20 22:00:40.485383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 498/951] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:40.491899 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:40.492712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:40.500519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.500975 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.501757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:40.502192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:40.528264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-adf86d8a-fd1a-4750-a768-6017981786e7 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/ips" status: 200 len: 145 microversion: 2.1 time: 0.041632 Jul 20 22:00:40.528841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 499/952] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 22:00:40 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:40.842479 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:40.879717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:40.884794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:40.891800 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f5f36403-3949-403e-a9a1-564003b46179 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.442620 Jul 20 22:00:40.917874 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 454/953] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:40 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:41.384957 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:41.386333 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:41.395395 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.396267 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:41.397552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.398193 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:41.455950 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:41.456894 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:41.463849 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.464564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:41.465566 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.466154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:41.593509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:41.603163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-460b1ccb-f758-4dfa-ade2-ba963de0430e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.222330 Jul 20 22:00:41.604250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 500/954] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:41 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:41.675664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:41.686700 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2a85d048-b246-4f5f-9b06-2a87ddce4501 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.236676 Jul 20 22:00:41.687333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 455/955] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:41 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:41.937090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:41.937639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:41.943954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.944405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:41.945183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:41.945839 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.054078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138b4547-b77c-44a2-a2c0-45ddc98df1e7"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:42.056137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:42.072896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.073350 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.074231 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.074854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.106551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:42.115235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:42.117226 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:42.119598 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-15253d46-71f9-4282-a56b-18d14928ffce tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.186760 Jul 20 22:00:42.131257 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 501/956] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:41 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:42.471283 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-735d008d-da99-46fc-b9a2-6b1008f7d5a0 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416869 Jul 20 22:00:42.471283 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 456/957] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:00:42 2022] POST /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:00:42.624321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:42.626119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:42.636196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.637069 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.638169 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.638821 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.733883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:42.734920 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:42.742353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.743669 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:42.744667 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:42.745267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:43.053300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:43.065266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f6426963-711c-45d1-9a2c-b4884ee8a1b6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.444954 Jul 20 22:00:43.066525 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 502/958] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:42 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:43.107389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:43.120281 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fae05f80-e867-43db-b096-746d0c37c2f7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.419049 Jul 20 22:00:43.121896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 457/959] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:42 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:43.147882 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:43.148678 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:43.157447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:43.158046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:43.158995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:43.159998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:43.327500 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:43.337785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:43.339465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:43.341183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b2c5d6b1-3922-4889-818b-c708e2b7dfed tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.197458 Jul 20 22:00:43.342229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 503/960] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:43 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:44.089018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:44.089998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:44.096807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.097266 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.098054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.098496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.137700 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:44.138398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:44.140408 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:44.147483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.147974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.149173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.150051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.312043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:44.315919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:44.325177 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ea5464be-5f8e-49c9-946a-a8f8851a8a0e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.244481 Jul 20 22:00:44.341896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 458/961] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:44 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:44.348259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:44.359400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b2284846-1eb9-4e5f-8a6e-4b869dc26102 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.225239 Jul 20 22:00:44.359885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:44.360906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:44.364175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:44.365038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:44.374399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.374733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 504/962] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:44 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:44.375561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.376527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:44.377152 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:44.540877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:44.549784 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:44.551316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:44.552769 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cb63f390-1b62-4956-804b-16c979188853 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.197153 Jul 20 22:00:44.564788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 459/963] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:44 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:45.343328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:45.343873 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:45.345778 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=14 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:45.352697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.353159 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.353935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.354805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.377997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:45.379000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:45.405172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.405858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.414312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.417279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.548013 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:45.559345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f0fe5e5d-86f3-43fa-adda-b333de40a9c6 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.219940 Jul 20 22:00:45.561558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 505/964] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:45 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:45.574174 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:45.575091 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:45.581493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.582184 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.583252 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.583688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.620269 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:45.629919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b52571b7-dcc7-4505-9932-546788eb649b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.257319 Jul 20 22:00:45.640854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 460/965] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:45 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:45.764281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:45.773932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:45.776693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:45.777972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7339222d-21a4-4b7d-a36c-a871776656f8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.209855 Jul 20 22:00:45.779179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 506/966] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:45 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:45.904949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-c93987c9-13a6-4d23-b8b2-764be6e94657 req-8769e71b-07c8-4f39-8961-30f1edab37ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02dfe472-7b0f-4521-8b13-533f3e25c91f", "name": "network-vif-plugged", "status": "completed", "tag": "cf32e8b2-508a-42c8-931a-f87aedbe4980"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:45.915861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c93987c9-13a6-4d23-b8b2-764be6e94657 req-8769e71b-07c8-4f39-8961-30f1edab37ee service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:45.916527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c93987c9-13a6-4d23-b8b2-764be6e94657 req-8769e71b-07c8-4f39-8961-30f1edab37ee service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:45.932468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-c93987c9-13a6-4d23-b8b2-764be6e94657 req-8769e71b-07c8-4f39-8961-30f1edab37ee service nova] Creating event network-vif-plugged:cf32e8b2-508a-42c8-931a-f87aedbe4980 for instance 02dfe472-7b0f-4521-8b13-533f3e25c91f on hv-cinder-84969 Jul 20 22:00:45.937842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-c93987c9-13a6-4d23-b8b2-764be6e94657 req-8769e71b-07c8-4f39-8961-30f1edab37ee service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039411 Jul 20 22:00:45.938998 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 461/967] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:46.576844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:46.578178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:46.587429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.588009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.588970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.589447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.648751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:46.650419 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:46.660287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.661059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.662067 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.663417 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.911512 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:46.916484 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1933a88b-88d9-445c-9c4f-fdba338d1a1c tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1368 microversion: 2.1 time: 0.343680 Jul 20 22:00:46.926231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 507/968] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:46 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1368 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:46.934646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:46.935672 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:46.942288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.943050 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.944054 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:46.944700 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:46.948130 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:46.957179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b4d20d9d-ee52-4e9f-ada8-d9bace702395 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.313075 Jul 20 22:00:46.958731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 462/969] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:46 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:47.128673 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:47.138038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:47.139707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:47.140939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-97a7d8d4-ad05-47da-add4-094312811118 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.213414 Jul 20 22:00:47.141937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 508/970] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:46 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:47.934600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:47.935263 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:47.942106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:47.942564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:47.943375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:47.944053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:47.979828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:47.981139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:47.997404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.004492 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.006374 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.006954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.546154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:48.561387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0665aca2-451c-4066-b22e-03cb2d0ba8f9 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1558 microversion: 2.1 time: 0.631215 Jul 20 22:00:48.574344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 463/971] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:47 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1558 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:48.581318 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:48.582268 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:48.592614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.594250 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.595376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.596016 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.606221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:48.619314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e48de55a-7d90-476b-8833-0b9579969f67 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.644858 Jul 20 22:00:48.620877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 509/972] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:47 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:48.625947 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:48.626447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:48.634777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.635265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.636080 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:48.636539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:48.796357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ea5cbcf1-5883-4794-962b-672155ce6fa4 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174361 Jul 20 22:00:48.797077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 510/973] 10.222.0.86 () {58 vars in 1274 bytes} [Wed Jul 20 22:00:48 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:48.836638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:48.848881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:48.848881 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:48.850071 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e2b924f5-323b-4a43-881c-00908c134814 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.273907 Jul 20 22:00:48.863369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 464/974] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:48 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:49.638325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:49.638938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:49.645263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:49.645713 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:49.646487 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:49.646919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:49.845626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:49.856620 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3fdc2132-78ab-4b17-826d-496d68ef6b43 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.223012 Jul 20 22:00:49.857411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 511/975] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:49 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:49.872352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:49.873614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:49.886940 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:49.888908 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:49.892258 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:49.893135 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:49.906329 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-51803003-4bc5-4294-adc2-ad97a58943a4 req-a68ae1df-5867-486d-ade0-151318983728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02dfe472-7b0f-4521-8b13-533f3e25c91f", "tag": "cf32e8b2-508a-42c8-931a-f87aedbe4980"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:49.920206 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-51803003-4bc5-4294-adc2-ad97a58943a4 req-a68ae1df-5867-486d-ade0-151318983728 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:49.920822 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-51803003-4bc5-4294-adc2-ad97a58943a4 req-a68ae1df-5867-486d-ade0-151318983728 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:49.946482 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-51803003-4bc5-4294-adc2-ad97a58943a4 req-a68ae1df-5867-486d-ade0-151318983728 service nova] Creating event network-changed:cf32e8b2-508a-42c8-931a-f87aedbe4980 for instance 02dfe472-7b0f-4521-8b13-533f3e25c91f on hv-cinder-84969 Jul 20 22:00:49.952537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-51803003-4bc5-4294-adc2-ad97a58943a4 req-a68ae1df-5867-486d-ade0-151318983728 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051171 Jul 20 22:00:49.953573 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 512/976] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:00:50.078780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-09e90260-2869-4c0c-a6dc-3ffe429b132a req-64b255a0-e23f-4aac-8874-298e00081dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "name": "network-vif-plugged", "status": "completed", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:50.082983 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:50.100483 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-09e90260-2869-4c0c-a6dc-3ffe429b132a req-64b255a0-e23f-4aac-8874-298e00081dfb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.100897 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:50.101553 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-09e90260-2869-4c0c-a6dc-3ffe429b132a req-64b255a0-e23f-4aac-8874-298e00081dfb service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.111415 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=100 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:50.112227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:50.114297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:50.115730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c908e71c-e2cf-4169-b3b9-70510be00b7c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1740 microversion: 2.20 time: 0.249511 Jul 20 22:00:50.116495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 465/977] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:49 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:50.122846 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-09e90260-2869-4c0c-a6dc-3ffe429b132a req-64b255a0-e23f-4aac-8874-298e00081dfb service nova] Creating event network-vif-plugged:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:00:50.129502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-09e90260-2869-4c0c-a6dc-3ffe429b132a req-64b255a0-e23f-4aac-8874-298e00081dfb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062189 Jul 20 22:00:50.130065 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 513/978] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:50.159251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:50.159251 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:50.165485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.165936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.166713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.167170 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.200163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b1f6ccd7-5b50-4e93-9ece-86b99f14cb5a tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Jul 20 22:00:50.200949 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 466/979] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:00:50 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:50.215326 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:50.215911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:50.224344 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.225195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.226149 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.227480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.293834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9a7aa42d-ba97-49ec-8fc7-ae1b20f9eb04 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7" status: 200 len: 194 microversion: 2.1 time: 0.083495 Jul 20 22:00:50.299407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 514/980] 10.222.0.86 () {58 vars in 1412 bytes} [Wed Jul 20 22:00:50 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:50.874524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:50.875443 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:50.882527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.882984 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:50.884598 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:50.885042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:51.032497 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:51.047391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-303ac396-d29e-47ca-88df-23a45d4e17d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.174962 Jul 20 22:00:51.047391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 467/981] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:50 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:51.136272 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:51.136925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:51.143736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:51.144814 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:51.145599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:51.146035 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:51.404998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:51.412970 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:51.415041 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:51.416217 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-436702e8-0c36-4a33-a778-9397a22dd75c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1722 microversion: 2.20 time: 0.284897 Jul 20 22:00:51.416796 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 515/982] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:51 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:51.747563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a586095-0f81-4dde-bc5d-14e279e5d31a"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:51.748831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:51.758811 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:51.759599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:51.760529 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:51.760989 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:52.064551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:52.065156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:52.071482 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:52.071925 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:52.072692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:52.073121 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:52.222841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:52.231364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7c0aa7ff-b567-4176-a05f-b462a3c26c4c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1258 microversion: 2.1 time: 0.170627 Jul 20 22:00:52.231950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 516/983] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:52 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:00:52.438139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:52.441286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:52.452724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:52.453547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:52.454653 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:52.455400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:52.480669 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b58e73c9-da51-434f-a8bf-0a1da14e3603 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "POST /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738136 Jul 20 22:00:52.486219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 468/984] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:00:51 2022] POST /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:52.617883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:52.626286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:52.627849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:52.629015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ec7bc043-1dd3-42a7-b80c-26ed28ca78fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1722 microversion: 2.20 time: 0.198859 Jul 20 22:00:52.629580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 517/985] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:52 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:00:53.250468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:53.251278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:53.258164 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.258719 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.259775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.260298 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.400561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:53.408310 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5ed62e5b-a9d6-44c9-9ff0-9046020871c1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1441 microversion: 2.1 time: 0.163234 Jul 20 22:00:53.408893 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 469/986] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:53 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1441 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:53.424827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:53.425433 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:53.432683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.433127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.433889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.434319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.581389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:53.589197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-21649059-684e-4bb3-a487-8a488890cd48 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1441 microversion: 2.1 time: 0.168275 Jul 20 22:00:53.589776 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 518/987] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:00:53 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1441 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:00:53.648481 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:53.650044 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:53.655553 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.656124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.656975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.657485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.825322 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:53.843214 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:53.845106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:53.847697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b60f2587-dd6a-42b7-b6db-a70418976770 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1722 microversion: 2.20 time: 0.203398 Jul 20 22:00:53.848789 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 470/988] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:53 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:53.860894 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-0e678110-cf47-4599-87b1-4f7d2e1a6260 req-ebd7b5d3-df9b-49e8-8d68-e7049dff5061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "name": "network-vif-unplugged", "status": "completed", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:53.871917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0e678110-cf47-4599-87b1-4f7d2e1a6260 req-ebd7b5d3-df9b-49e8-8d68-e7049dff5061 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:53.872379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-0e678110-cf47-4599-87b1-4f7d2e1a6260 req-ebd7b5d3-df9b-49e8-8d68-e7049dff5061 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:53.889014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-0e678110-cf47-4599-87b1-4f7d2e1a6260 req-ebd7b5d3-df9b-49e8-8d68-e7049dff5061 service nova] Creating event network-vif-unplugged:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 22:00:53.896740 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-0e678110-cf47-4599-87b1-4f7d2e1a6260 req-ebd7b5d3-df9b-49e8-8d68-e7049dff5061 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039528 Jul 20 22:00:53.897711 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 519/989] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:00:54.867401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:54.868791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:54.876260 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:54.876798 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:54.877648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:54.878158 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:55.038366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:55.047352 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:55.048892 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:55.050160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-74b0ee6e-aadf-4658-868b-89cbedf4fead tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1722 microversion: 2.20 time: 0.186910 Jul 20 22:00:55.050724 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 471/990] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:54 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:55.791299 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-a70fea84-c947-47fa-9246-f6686547da42 req-7cc1a5f4-4f41-4ece-a07d-b0e705c2d515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:55.800989 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a70fea84-c947-47fa-9246-f6686547da42 req-7cc1a5f4-4f41-4ece-a07d-b0e705c2d515 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:55.801547 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-a70fea84-c947-47fa-9246-f6686547da42 req-7cc1a5f4-4f41-4ece-a07d-b0e705c2d515 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:55.815227 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-a70fea84-c947-47fa-9246-f6686547da42 req-7cc1a5f4-4f41-4ece-a07d-b0e705c2d515 service nova] Creating event network-changed:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:00:55.827630 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-a70fea84-c947-47fa-9246-f6686547da42 req-7cc1a5f4-4f41-4ece-a07d-b0e705c2d515 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Jul 20 22:00:55.828245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 520/991] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:00:56.069165 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:56.070997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:56.078686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.079455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:56.080444 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.081057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:56.330821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:56.339613 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:56.341351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:56.342665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6d44973c-95b5-4f78-af3d-51324e62a4a0 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1665 microversion: 2.20 time: 0.277436 Jul 20 22:00:56.343391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 472/992] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:56 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1665 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:56.363197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c3a30ee-26df-4047-ad13-ef2750b825ea"}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:56.365025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:56.374549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.375837 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:56.377061 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.377506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:56.745898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b4a489ff-940f-4ac1-aaac-a5d551297f8d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.387095 Jul 20 22:00:56.746778 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 521/993] 10.222.0.86 () {62 vars in 1363 bytes} [Wed Jul 20 22:00:56 2022] POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments => generated 188 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:00:56.912321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:56.912321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:56.921151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.921610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:56.922389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:56.922824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:57.044817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:57.250677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-68864017-d265-405e-8317-89bf023ec448 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments/0c3a30ee-26df-4047-ad13-ef2750b825ea" status: 202 len: 0 microversion: 2.20 time: 0.343546 Jul 20 22:00:57.252094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 473/994] 10.222.0.86 () {60 vars in 1456 bytes} [Wed Jul 20 22:00:56 2022] DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments/0c3a30ee-26df-4047-ad13-ef2750b825ea => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:00:57.325341 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:00:57.326194 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:57.334586 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:57.335038 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:57.336787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:57.337243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:57.456409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d53c5496-5304-40fd-a97a-7359171325fd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/action" status: 202 len: 0 microversion: 2.20 time: 0.136384 Jul 20 22:00:57.457391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 522/995] 10.222.0.86 () {62 vars in 1318 bytes} [Wed Jul 20 22:00:57 2022] POST /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:00:57.466053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:57.466867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:57.483199 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:57.483831 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:57.485073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:57.485505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:57.667611 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:57.678361 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:57.681705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:57.682921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cedd23ff-ac97-44b8-96af-b031b0e74c33 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1673 microversion: 2.20 time: 0.220887 Jul 20 22:00:57.683517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 474/996] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:57 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:58.703905 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:58.705179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:00:58.712172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:58.712774 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:58.713660 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:00:58.714170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:00:58.963897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:58.972287 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:58.973830 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:00:58.975030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d006cb2c-c231-439a-ae04-2aa763147acf tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.275706 Jul 20 22:00:58.975629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 523/997] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:58 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:00:59.996385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:00:59.997747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:00.001445 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:00.010161 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:00.010611 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:00.011421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:00.011856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:00.165421 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:00.174369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:00.175946 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:00.177179 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bdf6e1db-58a0-4893-b132-1653cbf183bc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.187110 Jul 20 22:01:00.177751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 475/998] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:00:59 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:01.200533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:01.201308 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:01.207999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:01.208447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:01.209201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:01.209942 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:01.380766 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:01.391491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:01.393241 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:01.394467 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-13bee89e-d7c3-42f1-b46d-4bede9286b2a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.197973 Jul 20 22:01:01.395263 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 524/999] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:01 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:02.419515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:02.420079 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:02.426928 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:02.427415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:02.428198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:02.428634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:02.587476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:02.597138 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:02.598659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:02.599864 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-45d7c4ca-1dcc-49fe-a75d-49856bb2c6f5 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.188579 Jul 20 22:01:02.600440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 476/1000] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:02 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:03.630366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:03.631738 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:03.644609 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:03.645500 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:03.646832 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:03.647634 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:03.819345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:03.842139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:03.843707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:03.844909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b580e18e-7183-4f15-b2d2-71b2608dcf84 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.221161 Jul 20 22:01:03.847309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 525/1001] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:03 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:04.865848 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:04.867530 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:04.875125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:04.876141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:04.876985 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:04.877635 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:05.017692 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:05.027486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:05.029012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:05.030196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-def6c771-62e7-4801-a953-a530ca3de249 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.168757 Jul 20 22:01:05.030760 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 477/1002] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:04 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:06.049278 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:06.049870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:06.057220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:06.057661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:06.058420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:06.058849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:06.212862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:06.227025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:06.229369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:06.230755 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3b2a5b34-6b4d-430c-9a45-89306757a13e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.185730 Jul 20 22:01:06.231558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 526/1003] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:06 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:07.256870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:07.260451 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:07.268131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:07.268586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:07.269400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:07.269868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:07.424147 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:07.433304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:07.434820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:07.436028 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a35b9f5d-58d5-48a1-8350-47e83645842d tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.187654 Jul 20 22:01:07.436596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 478/1004] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:07 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:08.455411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:08.456497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:08.463479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:08.463926 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:08.464693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:08.465122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:08.615518 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:08.626391 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:08.628056 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:08.629614 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-60ed880c-a1cd-4411-8cc9-6f39d0607e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.178135 Jul 20 22:01:08.630181 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 527/1005] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:08 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:09.647761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:09.648373 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:09.656288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:09.656741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:09.657510 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:09.657952 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:09.798455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:09.807237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:09.808761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:09.809935 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-61dce74d-4454-43f1-a09d-cdfd6a21c7cc tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.166071 Jul 20 22:01:09.810504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 479/1006] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:09 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:10.828302 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:10.828906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:10.835437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:10.835828 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:10.837151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:10.837681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:10.842266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:10.989295 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:10.998559 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:11.000170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:11.001632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-05501a01-fd3e-4551-aebe-f1f2f2439e7e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.177226 Jul 20 22:01:11.002198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 528/1007] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:10 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:12.020750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:12.021348 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:12.029037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:12.029494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:12.030276 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:12.030718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:12.170854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:12.178857 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:12.181213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:12.182476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b75a49ab-1b79-437e-8490-df24aaf66a6c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.165773 Jul 20 22:01:12.183047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 480/1008] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:12 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:13.200870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:13.201479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:13.208198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:13.208657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:13.209432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:13.209902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:13.344663 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:13.353541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:13.354943 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:13.356123 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6294a01e-cd27-4637-a018-bc35ea3a66e8 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.159281 Jul 20 22:01:13.356902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 529/1009] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:13 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:14.374992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:14.375821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:14.382280 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:14.382730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:14.383561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:14.384238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:14.524601 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:14.533652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:14.535194 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:14.536366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-72272e38-dd71-48eb-883e-c96a76eca08b tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.165467 Jul 20 22:01:14.536939 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 481/1010] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:14 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:14.919053 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:14.920102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:14.926734 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:14.927228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:14.928015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:14.928446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:14.960660 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c845ac43-b383-4dc7-8668-18bba823c287 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045871 Jul 20 22:01:14.961229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 530/1011] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:01:14 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:15.082493 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:15.082625 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:15.090228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.090686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.091500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.091938 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.122826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-40e5fb34-37be-45de-b782-9c489b084c0b tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7" status: 200 len: 194 microversion: 2.1 time: 0.044697 Jul 20 22:01:15.123474 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 482/1012] 10.222.0.86 () {58 vars in 1412 bytes} [Wed Jul 20 22:01:15 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:15.133678 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:15.134177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:15.140232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.140688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.141458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.141897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.225225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lazy-loading 'services' on Instance uuid 74f8671a-1999-43cf-a51f-cc7ffb88f398 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:01:15.302006 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2aaa17aa-50f2-42bc-b8ed-bf752a943805 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7" status: 202 len: 0 microversion: 2.1 time: 0.172181 Jul 20 22:01:15.302599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 531/1013] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:01:15 2022] DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/138b4547-b77c-44a2-a2c0-45ddc98df1e7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:01:15.557305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:15.557906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:15.569727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.570570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.572312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.573092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.718496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:15.726590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:15.728661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:15.729841 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c8619e5a-60af-4418-9307-94c3b7d79a43 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.177826 Jul 20 22:01:15.730410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 483/1014] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:15 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:15.956026 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-7aff726f-f771-4727-bc18-87810c0a58d8 req-517b9718-017c-438c-a239-bef682b96e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "name": "network-vif-plugged", "status": "completed", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:01:15.965538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-7aff726f-f771-4727-bc18-87810c0a58d8 req-517b9718-017c-438c-a239-bef682b96e8d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:15.965985 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-7aff726f-f771-4727-bc18-87810c0a58d8 req-517b9718-017c-438c-a239-bef682b96e8d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:15.977123 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-7aff726f-f771-4727-bc18-87810c0a58d8 req-517b9718-017c-438c-a239-bef682b96e8d service nova] Creating event network-vif-plugged:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 22:01:15.982635 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-7aff726f-f771-4727-bc18-87810c0a58d8 req-517b9718-017c-438c-a239-bef682b96e8d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 Jul 20 22:01:15.983268 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 532/1015] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:16.748579 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:16.749198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:16.755954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:16.756409 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:16.757173 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:16.757612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:16.891521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:16.899981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:16.901503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:16.902668 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6b371061-6592-4aad-b5b5-43ce6abe29ba tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.158017 Jul 20 22:01:16.903257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 484/1016] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:16 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:17.482247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:17.482827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:17.489043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.489495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:17.490254 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.490692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:17.519852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-14769e95-be3f-47ec-86ae-b78cc083e289 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/3a586095-0f81-4dde-bc5d-14e279e5d31a" status: 200 len: 194 microversion: 2.1 time: 0.042823 Jul 20 22:01:17.520429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 533/1017] 10.222.0.86 () {58 vars in 1412 bytes} [Wed Jul 20 22:01:17 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/3a586095-0f81-4dde-bc5d-14e279e5d31a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:17.530167 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:17.530661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:17.536748 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.537202 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:17.537958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.538394 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:17.618511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lazy-loading 'services' on Instance uuid 74f8671a-1999-43cf-a51f-cc7ffb88f398 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:01:17.688508 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-864fdf70-07d6-46a4-b37e-5fec5929fe30 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/3a586095-0f81-4dde-bc5d-14e279e5d31a" status: 202 len: 0 microversion: 2.1 time: 0.162038 Jul 20 22:01:17.689082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 485/1018] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:01:17 2022] DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments/3a586095-0f81-4dde-bc5d-14e279e5d31a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:01:17.920803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:17.921447 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:17.927534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.927985 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:17.928748 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:17.929183 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:18.060867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:18.068886 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:18.070401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:18.072112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-deb71e0b-c1b6-4783-8fd2-f6dfc35cddc4 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1731 microversion: 2.20 time: 0.155380 Jul 20 22:01:18.072730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 534/1019] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:17 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:19.093741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:19.094447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:19.100957 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:19.101589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:19.102241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:19.103323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:19.254198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:19.263084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:19.264676 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:19.265835 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ec041341-fc61-4231-81b1-a758aac51f44 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1718 microversion: 2.20 time: 0.178838 Jul 20 22:01:19.266590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 486/1020] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:01:19 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:01:19.909815 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:19.910935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:19.918107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:19.918563 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:19.919374 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:19.919810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:19.952579 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bb3cbc34-d76b-4920-86b2-de123a78e610 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046861 Jul 20 22:01:19.953154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 535/1021] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:01:19 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:01:20.063955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:20.064883 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:20.071808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.072267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.073054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.073493 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.104011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c042c89a-2b5d-4b85-b421-5c95e441a183 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044139 Jul 20 22:01:20.104659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 487/1022] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:01:20 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:01:20.165509 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:20.166011 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:20.168010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=48 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:20.173347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.173795 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.174569 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.175000 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.200879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:01:20.280735 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-29aa1088-b751-4dfa-9c26-9b8aafdd70f8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 204 len: 0 microversion: 2.1 time: 0.119239 Jul 20 22:01:20.284480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 536/1023] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:01:20 2022] DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:01:20.291641 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:20.292279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:20.300735 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.301376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.302238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:20.302682 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:20.318385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SELECT=94 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:20.442630 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:20.450631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5a6b08e2-2575-4613-b42c-30c21ef865d8 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1674 microversion: 2.1 time: 0.164905 Jul 20 22:01:20.451242 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 488/1024] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:20 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:21.469170 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:21.469784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:21.478567 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:21.479010 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:21.479812 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:21.480240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:21.614148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:21.621931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ad7ac572-a097-4460-bb90-fc135175e4dd tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1674 microversion: 2.1 time: 0.157228 Jul 20 22:01:21.622508 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 537/1025] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:21 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:22.639416 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:22.640032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:22.646630 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:22.647102 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:22.647873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:22.648305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:22.799200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:22.807135 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b65e574f-9aeb-4b19-8da5-7fff4802e118 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1674 microversion: 2.1 time: 0.171499 Jul 20 22:01:22.807951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 489/1026] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:22 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:23.825889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:23.826601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:23.833842 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:23.834288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:23.835110 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:23.835538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:24.255602 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:24.264150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f39a8511-c407-415b-a7d2-3d18dad069c4 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1674 microversion: 2.1 time: 0.443792 Jul 20 22:01:24.264737 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 538/1027] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:23 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1674 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:24.610025 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-7bdf9372-79fb-42b7-a1fa-86b987be3d5e req-1e0d92bb-f4ca-4e6d-a00f-e8619796876a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f8671a-1999-43cf-a51f-cc7ffb88f398", "name": "network-vif-deleted", "tag": "e789d28d-85bd-42ee-80f5-d5005b709b15"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:01:24.620675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-7bdf9372-79fb-42b7-a1fa-86b987be3d5e req-1e0d92bb-f4ca-4e6d-a00f-e8619796876a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:24.621460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-7bdf9372-79fb-42b7-a1fa-86b987be3d5e req-1e0d92bb-f4ca-4e6d-a00f-e8619796876a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:24.642218 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-7bdf9372-79fb-42b7-a1fa-86b987be3d5e req-1e0d92bb-f4ca-4e6d-a00f-e8619796876a service nova] Creating event network-vif-deleted:e789d28d-85bd-42ee-80f5-d5005b709b15 for instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 on hv-cinder-84969 Jul 20 22:01:24.648362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-7bdf9372-79fb-42b7-a1fa-86b987be3d5e req-1e0d92bb-f4ca-4e6d-a00f-e8619796876a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Jul 20 22:01:24.654584 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 490/1028] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:25.281941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:25.283271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:25.290221 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:25.290666 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:25.291642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:25.292229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:25.330949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:25.331429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:25.331889 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lazy-loading 'fault' on Instance uuid 74f8671a-1999-43cf-a51f-cc7ffb88f398 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:01:25.384499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60f7f43c067e4b819aeb488e9f09197a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e722bb68652c48f588d8b53351c6f2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:25.392015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7668c00a-6013-4712-90f1-cfc1095918c3 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 200 len: 1328 microversion: 2.1 time: 0.114449 Jul 20 22:01:25.392699 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 539/1029] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:25 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:26.411761 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:26.412367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:26.419720 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:26.420171 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:26.420964 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:26.421395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:26.435344 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 HTTP/1.1 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:01:26.437010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:26.438588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '74f8671a-1999-43cf-a51f-cc7ffb88f398'} Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:01:26.439693 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:26.441254 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:26.442428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:01:26.442428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ec0d678a-c54b-4a69-b4ff-0e6c3b844320 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 404 len: 111 microversion: 2.1 time: 0.031694 Jul 20 22:01:26.442428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 491/1030] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:26 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:01:26.447568 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f12639ac-9df8-4e5e-a8a1-5cd110c9c31f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '.version_select at 0x7f6aba7c7670>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:26.465438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f12639ac-9df8-4e5e-a8a1-5cd110c9c31f tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146868970" status: 202 len: 0 microversion: 2.1 time: 0.021914 Jul 20 22:01:26.466017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 540/1031] 10.222.0.86 () {58 vars in 1220 bytes} [Wed Jul 20 22:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146868970 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:01:29.376652 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:29.377151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:29.384240 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:29.384727 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:29.385496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:29.385937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:29.399829 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 HTTP/1.1 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:01:29.401374 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.403009 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '74f8671a-1999-43cf-a51f-cc7ffb88f398'} Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:01:29.403967 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.405518 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.407083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:01:29.407083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6f4239f6-2569-48a1-9cd4-95b40314f991 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jul 20 22:01:29.407083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 492/1032] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:01:29 2022] DELETE /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:01:29.411800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:29.412437 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: 74f8671a-1999-43cf-a51f-cc7ffb88f398] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:29.419388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:29.419833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:29.420585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:29.421015 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:29.434131 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 HTTP/1.1 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:01:29.435804 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.437520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '74f8671a-1999-43cf-a51f-cc7ffb88f398'} Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:01:29.438359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. Jul 20 22:01:29.439600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:29.440671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance 74f8671a-1999-43cf-a51f-cc7ffb88f398 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:01:29.440671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9e2ae65f-ff99-48be-99be-b9ce2aad03c6 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398" status: 404 len: 111 microversion: 2.1 time: 0.029903 Jul 20 22:01:29.440671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 541/1033] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:29 2022] GET /compute/v2.1/servers/74f8671a-1999-43cf-a51f-cc7ffb88f398 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:01:30.576000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:30.576499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:30.578948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=36 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:30.584174 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:30.584623 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:30.585382 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:30.585819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:30.600063 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b HTTP/1.1 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:01:30.601622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.603795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'cd54893a-7604-4639-97b3-049128aac78b'} Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:01:30.604781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.606338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.608048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:01:30.608048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7861682e-9b75-403f-8f92-f46295af4502 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 404 len: 111 microversion: 2.1 time: 0.031722 Jul 20 22:01:30.608048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 493/1034] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:01:30 2022] DELETE /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:01:30.613257 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:30.613871 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] [instance: cd54893a-7604-4639-97b3-049128aac78b] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:30.621760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:30.622204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:30.622974 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:30.623441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:30.639017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] HTTP exception thrown: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Request method failure captured: Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b HTTP/1.1 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7-hh3hNIh34MhpmHO0im7Gfmi7_qwOPgKCkHRrOMcXR39xzf1CByuIDzMbzX_mHSS-earrgd8CPrCuDulSIjxBKrq73tteQrcrSqvcgf8WenZfkiUSZNWTpUVG9lTS5ewBVIdQu_2hivDNB0rpJiBZTWF2NIsX8m2LO4S4pLtEZU Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:01:30.640577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e722bb68652c48f588d8b53351c6f2a6", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e722bb68652c48f588d8b53351c6f2a6"}]}] Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: e722bb68652c48f588d8b53351c6f2a6 Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-88849206 Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 60f7f43c067e4b819aeb488e9f09197a Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeTestJSON-88849206-project Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.642202 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'cd54893a-7604-4639-97b3-049128aac78b'} Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:01:30.643427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. Jul 20 22:01:30.644874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:01:30.646366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] Returning 404 to user: Instance cd54893a-7604-4639-97b3-049128aac78b could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:01:30.646366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-96a4e57c-62d5-4c31-a296-8bf1e572b485 tempest-AttachVolumeTestJSON-88849206 tempest-AttachVolumeTestJSON-88849206-project] 10.222.0.86 "GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b" status: 404 len: 111 microversion: 2.1 time: 0.033085 Jul 20 22:01:30.646366 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 542/1035] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:30 2022] GET /compute/v2.1/servers/cd54893a-7604-4639-97b3-049128aac78b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:01:36.299070 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1eeac6e7-bfc1-451c-bd0d-daccec220914 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba61f5e0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:36.348219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1eeac6e7-bfc1-451c-bd0d-daccec220914 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/12584430-180e-4acb-b35e-a875d352b7de" status: 200 len: 351 microversion: 2.1 time: 0.052955 Jul 20 22:01:36.348795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 494/1036] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 22:01:36 2022] GET /compute/v2.1/os-volumes/12584430-180e-4acb-b35e-a875d352b7de => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:37.683789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e7cf61a0-1059-4c8d-a51f-1a05ff444dbc tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba7c7550>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:37.732479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e7cf61a0-1059-4c8d-a51f-1a05ff444dbc tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/3883ccf5-89a5-4bc4-9591-e5f0b51756f1" status: 200 len: 351 microversion: 2.1 time: 0.053012 Jul 20 22:01:37.733049 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 543/1037] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 22:01:37 2022] GET /compute/v2.1/os-volumes/3883ccf5-89a5-4bc4-9591-e5f0b51756f1 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.059802 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-51f35f06-8cb8-443d-892b-9f5ef66e355e tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba714790>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.110386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-51f35f06-8cb8-443d-892b-9f5ef66e355e tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/9d398387-d2e0-4b44-8376-7707c36bf459" status: 200 len: 351 microversion: 2.1 time: 0.054382 Jul 20 22:01:39.111072 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 495/1038] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes/9d398387-d2e0-4b44-8376-7707c36bf459 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.123787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f31c4e95-8123-4a78-9309-4ced3871a44a tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba4dc4c0>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.207938 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f31c4e95-8123-4a78-9309-4ced3871a44a tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088634 Jul 20 22:01:39.208578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 544/1039] 10.222.0.86 () {58 vars in 1133 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:39.220635 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4f7bc23-4bae-463f-b167-45154dadee92 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba513820>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.308541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d4f7bc23-4bae-463f-b167-45154dadee92 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091691 Jul 20 22:01:39.309342 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 496/1040] 10.222.0.86 () {58 vars in 1148 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.322446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ef64af10-6c08-4a29-a9f5-6c5b84e7f3e7 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba76d670>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.403581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ef64af10-6c08-4a29-a9f5-6c5b84e7f3e7 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085697 Jul 20 22:01:39.404143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 545/1041] 10.222.0.86 () {58 vars in 1133 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:39.416010 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c1a72b98-12b5-4999-9b7b-49d43822dcbe tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba6f3a60>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.500383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c1a72b98-12b5-4999-9b7b-49d43822dcbe tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088874 Jul 20 22:01:39.501253 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 497/1042] 10.222.0.86 () {58 vars in 1166 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.516539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-236f4d24-637a-4c9c-932e-cedbeadaf773 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba4dc280>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.597764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-236f4d24-637a-4c9c-932e-cedbeadaf773 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085813 Jul 20 22:01:39.598337 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 546/1043] 10.222.0.86 () {58 vars in 1169 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.610965 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f187fd40-d95c-4808-93ca-d110d4be41ee tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba714af0>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.694885 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f187fd40-d95c-4808-93ca-d110d4be41ee tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087748 Jul 20 22:01:39.695681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 498/1044] 10.222.0.86 () {58 vars in 1154 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:01:39.707180 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-bdd0a6be-6bbe-4e61-bd29-08eb8ee44a96 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba7b3550>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.790384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-bdd0a6be-6bbe-4e61-bd29-08eb8ee44a96 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086804 Jul 20 22:01:39.790961 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 547/1045] 10.222.0.86 () {58 vars in 1187 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:39.802524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-14123179-fbca-48fb-b728-01ee018ac0b8 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] Calling method '.version_select at 0x7f6aba714310>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:39.889777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-14123179-fbca-48fb-b728-01ee018ac0b8 tempest-VolumesTestJSON-1628543404 tempest-VolumesTestJSON-1628543404-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.091023 Jul 20 22:01:39.890340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 499/1046] 10.222.0.86 () {58 vars in 1154 bytes} [Wed Jul 20 22:01:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:45.843157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:45.844125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:45.848716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:45.849209 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:45.857141 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:45.857589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:45.858515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:45.859023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:45.886909 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0efcfbfa-2db0-4b3b-a92f-6eb5fce174e2 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/ips" status: 200 len: 149 microversion: 2.1 time: 0.045573 Jul 20 22:01:45.887539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 548/1047] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 22:01:45 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:47.221348 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:47.222588 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=17 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:47.227937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90ac5a72-237d-433e-81de-3b9e4cbbabe5"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:01:47.229015 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:47.236596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:47.237056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:47.237834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:47.238271 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:47.497606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-084a0949-f170-4dba-b9dd-2b3b630f9a73 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "POST /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278075 Jul 20 22:01:47.498225 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 500/1048] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:01:47 2022] POST /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:55.123197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:55.123703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:55.130231 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:55.130688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:55.131499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:55.132073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:55.220745 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'services' on Instance uuid 02dfe472-7b0f-4521-8b13-533f3e25c91f {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:01:55.297100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ec48fe83-862e-4f0e-a7ee-ba7ce767a55a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments/90ac5a72-237d-433e-81de-3b9e4cbbabe5" status: 202 len: 0 microversion: 2.1 time: 0.178082 Jul 20 22:01:55.297789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 549/1049] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:01:55 2022] DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments/90ac5a72-237d-433e-81de-3b9e4cbbabe5 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:01:55.308052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:55.309081 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:55.315678 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:55.316145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:55.317042 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:55.317462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:55.351070 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e8b5c022-4a10-41bc-95d7-80a83b61238a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Jul 20 22:01:55.351686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 501/1050] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:01:55 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:01:56.363890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:56.364976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:56.371866 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.372322 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.373086 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.373541 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.402314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b67632e2-56f4-4208-899c-55586017d54a tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043321 Jul 20 22:01:56.402868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 550/1051] 10.222.0.86 () {58 vars in 1301 bytes} [Wed Jul 20 22:01:56 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:01:56.460464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:56.460961 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:56.467743 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.468197 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.468962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.469400 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.496383 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:01:56.574937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-eaa021c3-3ddb-4aa5-907d-49f65a10bfb1 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 204 len: 0 microversion: 2.1 time: 0.117897 Jul 20 22:01:56.575879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 502/1052] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:01:56 2022] DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:01:56.585323 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:56.585950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:56.592982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.593428 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.594220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:56.595316 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:56.732747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:56.740367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9f48fb2b-6ce8-4454-816a-987f500a3e82 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1682 microversion: 2.1 time: 0.159826 Jul 20 22:01:56.740941 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 551/1053] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:56 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:57.761335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:57.762054 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:57.771843 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:57.772336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:57.773193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:57.773496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:57.944270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:57.953115 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3de831c4-3b1d-4077-b566-159a6cdc7373 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1682 microversion: 2.1 time: 0.198998 Jul 20 22:01:57.953706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 503/1054] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:57 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:58.973790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:01:58.974501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:01:58.982027 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:58.982480 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:58.983328 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:58.983763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:59.215720 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:01:59.232939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-226b8b87-b313-4d74-87d6-1621e702e148 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1682 microversion: 2.1 time: 0.262937 Jul 20 22:01:59.233791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 552/1055] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:01:58 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:01:59.878988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-6d18756c-7a1f-4500-a258-267727ffbd21 req-6512d3a0-fe4f-4623-8d01-2dc9a0a66a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02dfe472-7b0f-4521-8b13-533f3e25c91f", "name": "network-vif-deleted", "tag": "cf32e8b2-508a-42c8-931a-f87aedbe4980"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:01:59.889129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6d18756c-7a1f-4500-a258-267727ffbd21 req-6512d3a0-fe4f-4623-8d01-2dc9a0a66a25 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:01:59.889580 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6d18756c-7a1f-4500-a258-267727ffbd21 req-6512d3a0-fe4f-4623-8d01-2dc9a0a66a25 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:01:59.912610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-6d18756c-7a1f-4500-a258-267727ffbd21 req-6512d3a0-fe4f-4623-8d01-2dc9a0a66a25 service nova] Creating event network-vif-deleted:cf32e8b2-508a-42c8-931a-f87aedbe4980 for instance 02dfe472-7b0f-4521-8b13-533f3e25c91f on hv-cinder-84969 Jul 20 22:01:59.917869 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-6d18756c-7a1f-4500-a258-267727ffbd21 req-6512d3a0-fe4f-4623-8d01-2dc9a0a66a25 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042767 Jul 20 22:01:59.918521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 504/1056] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:02:00.251421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:00.252153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:00.258860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:00.259580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:00.260436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:00.260939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:00.295312 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:00.295849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:00.296549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lazy-loading 'fault' on Instance uuid 02dfe472-7b0f-4521-8b13-533f3e25c91f {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:02:00.343853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58389cb50e140d69f1d4c99d6d0e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41b592357304d8787cc8e1ab4c9df15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:00.351587 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3bd0a683-fb53-4b46-a8c5-9112f36b1995 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 200 len: 1332 microversion: 2.1 time: 0.104359 Jul 20 22:02:00.352621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 553/1057] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:00 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:02:01.371118 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:01.371943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:01.378953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:01.379495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:01.380347 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:01.380875 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:01.395660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f HTTP/1.1 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:01.397236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:01.398914 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '02dfe472-7b0f-4521-8b13-533f3e25c91f'} Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:01.399770 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:01.401098 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:01.402333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:01.402333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-59f35633-1223-4728-844f-f76f4c4e2b67 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 404 len: 111 microversion: 2.1 time: 0.033227 Jul 20 22:02:01.402333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 505/1058] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:01 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:01.408340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-11477c06-c0a0-4972-ba69-5bc8e2d24e1e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '.version_select at 0x7f6aba84f310>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:01.427250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-11477c06-c0a0-4972-ba69-5bc8e2d24e1e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057766579" status: 202 len: 0 microversion: 2.1 time: 0.022667 Jul 20 22:02:01.432122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 554/1059] 10.222.0.86 () {58 vars in 1220 bytes} [Wed Jul 20 22:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057766579 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:02:03.538930 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:03.540073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:03.546244 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:03.546699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:03.547522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:03.547963 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:03.562172 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f HTTP/1.1 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:03.563764 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.565159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '02dfe472-7b0f-4521-8b13-533f3e25c91f'} Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:03.565911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.568216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.569943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:03.569943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8846fb2f-a026-4741-a9ba-0a0bc6b1b069 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 404 len: 111 microversion: 2.1 time: 0.030197 Jul 20 22:02:03.569943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 506/1060] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:02:03 2022] DELETE /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:03.576853 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:03.577503 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 02dfe472-7b0f-4521-8b13-533f3e25c91f] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:03.584580 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:03.585036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:03.585819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:03.586940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:03.602879 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f HTTP/1.1 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:03.604293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.605851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '02dfe472-7b0f-4521-8b13-533f3e25c91f'} Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:03.606767 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. Jul 20 22:02:03.608475 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:03.609958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 02dfe472-7b0f-4521-8b13-533f3e25c91f could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:03.609958 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3d925471-03ba-4a86-b2bb-c356d6de1e05 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f" status: 404 len: 111 microversion: 2.1 time: 0.034179 Jul 20 22:02:03.611134 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 555/1061] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:03 2022] GET /compute/v2.1/servers/02dfe472-7b0f-4521-8b13-533f3e25c91f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:04.750137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:04.750880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:04.757404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.758526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.759365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.759814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.773341 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 HTTP/1.1 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:04.774903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.776501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'f20c7cdc-854d-4d66-91d9-6b6da979ee15'} Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:04.777399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.778873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.780439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:04.780439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d4e48454-9298-4d3a-899b-889a28f82aec tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 404 len: 111 microversion: 2.1 time: 0.030085 Jul 20 22:02:04.780439 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 507/1062] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:02:04 2022] DELETE /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:04.784626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:04.785248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: f20c7cdc-854d-4d66-91d9-6b6da979ee15] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:04.791805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.792254 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.793020 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.793453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.807451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 HTTP/1.1 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:04.809192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.810827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'f20c7cdc-854d-4d66-91d9-6b6da979ee15'} Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:04.811799 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. Jul 20 22:02:04.813059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.814220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance f20c7cdc-854d-4d66-91d9-6b6da979ee15 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:04.814220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-625ec705-da5e-494c-bb05-755aaa90f3f8 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jul 20 22:02:04.814220 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 556/1063] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:04 2022] GET /compute/v2.1/servers/f20c7cdc-854d-4d66-91d9-6b6da979ee15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:04.819151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:04.819642 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:04.826442 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.826891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.827690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.828128 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.841501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 HTTP/1.1 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:04.843026 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.845367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9'} Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:04.846842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.848562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.850290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:04.850290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2b850e04-dd6d-4e57-86a6-e3fbd28d96be tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 404 len: 111 microversion: 2.1 time: 0.029170 Jul 20 22:02:04.850290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 508/1064] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:02:04 2022] DELETE /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:04.854073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:04.854683 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:04.860887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.861339 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.862107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:04.862540 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:04.877144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 HTTP/1.1 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:04.878693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.880282 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9'} Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:04.881125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. Jul 20 22:02:04.882417 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:04.884289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:04.884289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3583010c-e19c-43ce-8366-372ed77d2aac tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9" status: 404 len: 111 microversion: 2.1 time: 0.029967 Jul 20 22:02:04.884289 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 557/1065] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:04 2022] GET /compute/v2.1/servers/8bec63d7-123f-4f2d-a16e-1fa5ebf1cca9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:06.015018 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:06.015562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:06.022017 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:06.022461 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:06.023261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:06.024477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:06.037803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a HTTP/1.1 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:06.039432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.041012 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '5a027718-c5db-48a7-bafd-4b4130e2380a'} Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:06.041923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.044001 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.045586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:06.045586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1c9ebb48-55b3-44d5-a0c8-254dc6a9060e tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 404 len: 111 microversion: 2.1 time: 0.029752 Jul 20 22:02:06.045586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 509/1066] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:02:06 2022] DELETE /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:06.049383 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:06.049995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] [instance: 5a027718-c5db-48a7-bafd-4b4130e2380a] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:06.057481 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:06.057927 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:06.058693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:06.059157 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:06.074017 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] HTTP exception thrown: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Request method failure captured: Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a HTTP/1.1 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hku4lWxvYEEkyqsuvi0VpEMMTQi3rdqRsDA2sD9-Nn7iJk1acDmDvzhWS4pPsYXZNlw5dIgUXjzY8BnoF1V7rgqGTXpyoLE_9Px8odooWPwy5wSRcl3U0S9KoGMIUY2bgCNiTZhjNZ2bg01vnU915LP2zD1NFEmabZUBVugEuo04CU Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:06.075665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a41b592357304d8787cc8e1ab4c9df15", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a41b592357304d8787cc8e1ab4c9df15"}]}] Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: a41b592357304d8787cc8e1ab4c9df15 Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86753853 Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: c58389cb50e140d69f1d4c99d6d0e182 Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeNegativeTest-86753853-project Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.077245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '5a027718-c5db-48a7-bafd-4b4130e2380a'} Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:06.078037 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. Jul 20 22:02:06.079286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:06.080372 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] Returning 404 to user: Instance 5a027718-c5db-48a7-bafd-4b4130e2380a could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:06.080372 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3505d838-8578-4be0-8ddd-a158c140db98 tempest-AttachVolumeNegativeTest-86753853 tempest-AttachVolumeNegativeTest-86753853-project] 10.222.0.86 "GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a" status: 404 len: 111 microversion: 2.1 time: 0.031540 Jul 20 22:02:06.080372 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 558/1067] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:02:06 2022] GET /compute/v2.1/servers/5a027718-c5db-48a7-bafd-4b4130e2380a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 22:02:11.227659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.228671 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:11.238127 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.239082 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.240075 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.240593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.271955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-60e78082-9568-4011-8508-a50a862aae03 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050271 Jul 20 22:02:11.272527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 510/1068] 10.222.0.86 () {60 vars in 1342 bytes} [Wed Jul 20 22:02:11 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:02:11.333809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.334312 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:11.341321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.341780 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.342561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.342999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.373216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:02:11.459508 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c185c4a8-1e3e-4a26-af10-be044785ee5f tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 204 len: 0 microversion: 2.20 time: 0.129052 Jul 20 22:02:11.461412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 511/1069] 10.222.0.86 () {60 vars in 1279 bytes} [Wed Jul 20 22:02:11 2022] DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 22:02:11.471660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.472563 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:11.483901 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.484639 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.485660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:11.486367 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:11.537025 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3ced65d8-6f32-4fd5-8148-c5aacebaf9f1 tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Action: 'create', calling method: .version_select at 0x7f6abaa630d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-800226238", "metadata": {"Type": "work"}}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3ced65d8-6f32-4fd5-8148-c5aacebaf9f1 tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 121 Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:11.556693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-800226238", "metadata": {"Type": "work"}}} Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 22:02:11.558288 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-800226238', 'metadata': {'Type': 'work'}}}} Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.559280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:02:11.560636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:02:11.561810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:02:11.561810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.561810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3ced65d8-6f32-4fd5-8148-c5aacebaf9f1 tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.561810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3ced65d8-6f32-4fd5-8148-c5aacebaf9f1 tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.327040 Jul 20 22:02:11.561810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 559/1070] 10.222.0.86 () {60 vars in 1155 bytes} [Wed Jul 20 22:02:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 22:02:11.567935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0916a80d-7d34-41e8-98b1-033565355abd tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Action: 'create', calling method: .version_select at 0x7f6aba7b3790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-943073637", "metadata": {"Type": "work"}}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0916a80d-7d34-41e8-98b1-033565355abd tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 119 Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:11.571888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-943073637", "metadata": {"Type": "work"}}} Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 22:02:11.573499 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-943073637', 'metadata': {'Type': 'work'}}}} Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi '0' Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.574491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:02:11.576142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:02:11.577445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:02:11.577445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.577445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0916a80d-7d34-41e8-98b1-033565355abd tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.577445 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0916a80d-7d34-41e8-98b1-033565355abd tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009126 Jul 20 22:02:11.578186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 560/1071] 10.222.0.86 () {60 vars in 1155 bytes} [Wed Jul 20 22:02:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 22:02:11.592705 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e83378d0-4478-4fc5-8734-5e853f50b90f tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Action: 'create', calling method: .version_select at 0x7f6aba805b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1099597683", "metadata": {"Type": "work"}}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e83378d0-4478-4fc5-8734-5e853f50b90f tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 119 Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:11.595265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1099597683", "metadata": {"Type": "work"}}} Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 22:02:11.597376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1099597683', 'metadata': {'Type': 'work'}}}} Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi '' Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.598332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:02:11.600243 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:02:11.602436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:02:11.602436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.602436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e83378d0-4478-4fc5-8734-5e853f50b90f tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.602436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e83378d0-4478-4fc5-8734-5e853f50b90f tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008015 Jul 20 22:02:11.602436 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 561/1072] 10.222.0.86 () {60 vars in 1155 bytes} [Wed Jul 20 22:02:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:11.613983 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-430edf01-2c4f-4b5b-a86b-7d64ecc815eb tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Calling method '.version_select at 0x7f6aba7ba940>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.644703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-430edf01-2c4f-4b5b-a86b-7d64ecc815eb tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] HTTP exception thrown: Volume tempest-invalid-1033611137 could not be found. Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-430edf01-2c4f-4b5b-a86b-7d64ecc815eb tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1033611137 HTTP/1.1 Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:11.647297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Volume tempest-invalid-1033611137 could not be found. Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'tempest-invalid-1033611137'} Jul 20 22:02:11.649441 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1033611137 could not be found. (HTTP 404) (Request-ID: req-e301cd24-6947-4b0c-a9d8-0e39185407e2) Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.650409 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:02:11.651946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1033611137 could not be found. Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:11.653124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1033611137 could not be found. Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1033611137 could not be found. Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-430edf01-2c4f-4b5b-a86b-7d64ecc815eb tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 404 to user: Volume tempest-invalid-1033611137 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-430edf01-2c4f-4b5b-a86b-7d64ecc815eb tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1033611137" status: 404 len: 99 microversion: 2.1 time: 0.039429 Jul 20 22:02:11.654564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 562/1073] 10.222.0.86 () {58 vars in 1217 bytes} [Wed Jul 20 22:02:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1033611137 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 22:02:11.661068 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-34f32ccc-f0c1-469e-b991-158dc10b1a0c tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004445 Jul 20 22:02:11.661785 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 563/1074] 10.222.0.86 () {58 vars in 1139 bytes} [Wed Jul 20 22:02:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 22:02:11.673198 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9df3e630-35d7-4b06-86cc-d626af935c2e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004022 Jul 20 22:02:11.674039 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 564/1075] 10.222.0.86 () {58 vars in 1136 bytes} [Wed Jul 20 22:02:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 22:02:11.680316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:11.684031 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0f91ab6e-a374-455e-9ba5-904af2d9311e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Calling method '.version_select at 0x7f6abaa63f70>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.690409 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:11.692710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:11.694556 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ff2db5a0-88b1-4d65-ad59-8f11225e1f80 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.228648 Jul 20 22:02:11.699110 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 512/1076] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:11 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:02:11.712716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-0f91ab6e-a374-455e-9ba5-904af2d9311e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] HTTP exception thrown: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0f91ab6e-a374-455e-9ba5-904af2d9311e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: DELETE /compute/v2.1/os-volumes/4321850a-4f31-49b3-8eaa-a673639c3ec7 HTTP/1.1 Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:11.714763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '4321850a-4f31-49b3-8eaa-a673639c3ec7'} Jul 20 22:02:11.716352 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. (HTTP 404) (Request-ID: req-415e1ebb-1c95-4d3b-9470-289b8af66a6e) Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.717327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:02:11.718599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 22:02:11.719937 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-0f91ab6e-a374-455e-9ba5-904af2d9311e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 404 to user: Volume 4321850a-4f31-49b3-8eaa-a673639c3ec7 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-0f91ab6e-a374-455e-9ba5-904af2d9311e tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/4321850a-4f31-49b3-8eaa-a673639c3ec7" status: 404 len: 109 microversion: 2.1 time: 0.037595 Jul 20 22:02:11.721357 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 565/1077] 10.222.0.86 () {58 vars in 1247 bytes} [Wed Jul 20 22:02:11 2022] DELETE /compute/v2.1/os-volumes/4321850a-4f31-49b3-8eaa-a673639c3ec7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 22:02:11.729391 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5970d485-dff3-415d-8f11-927c280726ec tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Calling method '.version_select at 0x7f6aba6f3280>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:11.763994 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-5970d485-dff3-415d-8f11-927c280726ec tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] HTTP exception thrown: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5970d485-dff3-415d-8f11-927c280726ec tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Request method failure captured: Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/os-volumes/40883b25-e0fe-455c-85a7-656a9bcf80c6 HTTP/1.1 Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2HtjgnM6Du7En0cK8ULuu3eXTpfUMoDwnnNsLkmDzlTGfC0GcXAapLVYxE8qVwDWGN2JhvxAgVpnOJfKHiEux_siBW-Bw2eeopHMy6wAYsQNIZ2Kv5PvYLt_uU5ysxf4vfUo-OabqBeQVLoMV2owdi9kPu8aFYw3ugOOAwKe8h2iI5s Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:11.766338 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d8d189cc396346bb91dbaf2af29b747a", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d8d189cc396346bb91dbaf2af29b747a"}]}] Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: d8d189cc396346bb91dbaf2af29b747a Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-VolumesNegativeTest-1816633223 Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 2cacbaf0e55a4b8ea0dd0fddd07db7d9 Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-VolumesNegativeTest-1816633223-project Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '40883b25-e0fe-455c-85a7-656a9bcf80c6'} Jul 20 22:02:11.767936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. (HTTP 404) (Request-ID: req-1238fa1e-024d-43c2-a1e9-a94fb92ad20a) Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.768814 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:02:11.770599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 22:02:11.775981 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-5970d485-dff3-415d-8f11-927c280726ec tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] Returning 404 to user: Volume 40883b25-e0fe-455c-85a7-656a9bcf80c6 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-5970d485-dff3-415d-8f11-927c280726ec tempest-VolumesNegativeTest-1816633223 tempest-VolumesNegativeTest-1816633223-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/40883b25-e0fe-455c-85a7-656a9bcf80c6" status: 404 len: 109 microversion: 2.1 time: 0.043686 Jul 20 22:02:11.779335 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 513/1078] 10.222.0.86 () {58 vars in 1244 bytes} [Wed Jul 20 22:02:11 2022] GET /compute/v2.1/os-volumes/40883b25-e0fe-455c-85a7-656a9bcf80c6 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:02:12.714784 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:12.715535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:12.721953 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:12.722473 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:12.723346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:12.723997 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:12.878583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:12.887759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:12.889284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:12.890877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-7c63562b-ce17-44f5-b889-5efa3d10a0c9 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1724 microversion: 2.20 time: 0.181469 Jul 20 22:02:12.891632 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 566/1079] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:12 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:02:13.913045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:13.915123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:13.924029 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:13.924490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:13.925385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:13.925691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:14.014736 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:14.024871 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:14.033738 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb27ee14314f42cc87e8e6bac2031c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e4a1ceb7b94c4ea11fbbeb8ee0c006', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:02:14.036145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fda37179-a796-44eb-8652-aed4e1628afd tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 200 len: 1656 microversion: 2.20 time: 0.128178 Jul 20 22:02:14.036854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 514/1080] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:13 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 1656 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:02:14.260429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-b775dd08-29a9-4210-ac99-a6b58307b8cd req-adc9e38a-6e7f-4a29-b013-42c939df4f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41cc4ec-c523-4740-b1b3-ad9a3a9469a0", "name": "network-vif-deleted", "tag": "b8e48414-6db6-49f2-a93b-02f6345aaec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:02:14.270313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-b775dd08-29a9-4210-ac99-a6b58307b8cd req-adc9e38a-6e7f-4a29-b013-42c939df4f00 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:14.270756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-b775dd08-29a9-4210-ac99-a6b58307b8cd req-adc9e38a-6e7f-4a29-b013-42c939df4f00 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:14.302641 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-b775dd08-29a9-4210-ac99-a6b58307b8cd req-adc9e38a-6e7f-4a29-b013-42c939df4f00 service nova] Creating event network-vif-deleted:b8e48414-6db6-49f2-a93b-02f6345aaec4 for instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 on hv-cinder-84969 Jul 20 22:02:14.311806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-b775dd08-29a9-4210-ac99-a6b58307b8cd req-adc9e38a-6e7f-4a29-b013-42c939df4f00 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064183 Jul 20 22:02:14.312698 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 567/1081] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:02:15.056926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:15.058365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:15.065014 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:15.065765 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:15.066594 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:15.067339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:15.081597 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 HTTP/1.1 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:15.083557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:15.085316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'f41cc4ec-c523-4740-b1b3-ad9a3a9469a0'} Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:15.087105 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:15.091937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:15.093336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:15.093336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a31f6a2e-3fbf-482b-9e08-fb8c33827eb3 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 404 len: 111 microversion: 2.20 time: 0.035764 Jul 20 22:02:15.093336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 515/1082] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:15 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:15.096805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-99386ee0-552d-4605-8a60-5ac8e34f9d6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '.version_select at 0x7f6abbba0700>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:15.117628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-99386ee0-552d-4605-8a60-5ac8e34f9d6e tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117601613" status: 204 len: 0 microversion: 2.20 time: 0.025070 Jul 20 22:02:15.118301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 568/1083] 10.222.0.86 () {60 vars in 1261 bytes} [Wed Jul 20 22:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117601613 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 22:02:17.114064 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:17.114572 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:17.121926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:17.122395 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:17.123216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:17.123673 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:17.141454 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 HTTP/1.1 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:17.143125 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.144728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'f41cc4ec-c523-4740-b1b3-ad9a3a9469a0'} Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:17.145612 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.146972 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.149248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:17.149248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4902b7fb-543f-4b9d-af00-11188f8d5d34 tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 404 len: 111 microversion: 2.20 time: 0.034496 Jul 20 22:02:17.149248 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 516/1084] 10.222.0.86 () {60 vars in 1279 bytes} [Wed Jul 20 22:02:17 2022] DELETE /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:17.156983 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:17.157895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: f41cc4ec-c523-4740-b1b3-ad9a3a9469a0] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:17.163736 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:17.171572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:17.172392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:17.173438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:17.174033 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:17.177761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:17.191432 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 HTTP/1.1 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:17.193228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.194691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'f41cc4ec-c523-4740-b1b3-ad9a3a9469a0'} Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:17.196055 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. Jul 20 22:02:17.198058 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:17.199398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:17.199398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fa45d3d1-3221-4339-8ec0-feeb3077be9c tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0" status: 404 len: 111 microversion: 2.20 time: 0.043365 Jul 20 22:02:17.199398 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 569/1085] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:17 2022] GET /compute/v2.1/servers/f41cc4ec-c523-4740-b1b3-ad9a3a9469a0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:18.370065 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:18.370659 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:18.374356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:18.378420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:18.378954 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:18.379955 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:18.380404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:18.386476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:18.400450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 HTTP/1.1 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:02:18.402131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.403832 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '6f8a564c-d369-4d26-836f-0d5498d8cbc9'} Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:18.404589 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.405907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.407267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:18.407267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d1796c09-7b0a-41d1-829a-2b9df37efc0a tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 404 len: 111 microversion: 2.20 time: 0.038315 Jul 20 22:02:18.407267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 517/1086] 10.222.0.86 () {60 vars in 1279 bytes} [Wed Jul 20 22:02:18 2022] DELETE /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:18.412412 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:02:18.413019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] [instance: 6f8a564c-d369-4d26-836f-0d5498d8cbc9] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:02:18.420117 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:18.420573 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:18.421340 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:02:18.421955 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:02:18.436250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] HTTP exception thrown: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Request method failure captured: Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 HTTP/1.1 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hk7DQEQYDkXIyQ3ZYzHYfnquo5gENApHnX2wRghf1oopW8CM29dnPWHRENvS7lw9GYW1N9N5Yyt4VRg-HS_ALRD7hEJu1Pr1hvSjwW707T8EFFRXMSPDAiIFqN2QRuR5Tz2lWexsqQrMs8JjlyotRpKrpdrh8C62xedBodKf2Kebg8 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:02:18.437806 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_37e4a1ceb7b94c4ea11fbbeb8ee0c006", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/37e4a1ceb7b94c4ea11fbbeb8ee0c006"}]}] Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 37e4a1ceb7b94c4ea11fbbeb8ee0c006 Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1306659441 Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: fb27ee14314f42cc87e8e6bac2031c70 Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1306659441-project Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.439315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '6f8a564c-d369-4d26-836f-0d5498d8cbc9'} Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:02:18.440127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. Jul 20 22:02:18.441479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:02:18.442787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] Returning 404 to user: Instance 6f8a564c-d369-4d26-836f-0d5498d8cbc9 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:02:18.442787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1e43c8be-409b-44c1-b6cd-1f62471d41fe tempest-AttachVolumeShelveTestJSON-1306659441 tempest-AttachVolumeShelveTestJSON-1306659441-project] 10.222.0.86 "GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9" status: 404 len: 111 microversion: 2.20 time: 0.030964 Jul 20 22:02:18.442787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 570/1087] 10.222.0.86 () {60 vars in 1276 bytes} [Wed Jul 20 22:02:18 2022] GET /compute/v2.1/servers/6f8a564c-d369-4d26-836f-0d5498d8cbc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:02:47.648576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:02:47.649121 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:03:01.355229 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:03:01.355782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:03:18.097278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:18.097870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:18.100468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:18.107607 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:18.108059 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:18.108842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:18.109279 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:18.137326 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lazy-loading 'flavor' on Instance uuid 502fdc2f-4dfc-44de-809c-70086990db22 {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:03:18.237161 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bdf4d40f-e2c6-42be-8aa6-8fca84fe08c8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "POST /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22/action" status: 202 len: 0 microversion: 2.1 time: 0.144310 Jul 20 22:03:18.237935 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 518/1088] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 22:03:18 2022] POST /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:03:18.255166 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:18.255788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:18.259629 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:18.260291 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:18.264741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:18.265201 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:18.265986 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:18.266502 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:18.573632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2139386647", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "networks": [{"uuid": "96cc28b4-a280-44bb-8d27-77b4de1d254b"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:18.648414 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:18.656666 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ec963eae-b85d-41e2-b682-e5c381e38fb9 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.407261 Jul 20 22:03:18.657346 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 571/1089] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:18 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:18.832198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] validate_networks() for [('96cc28b4-a280-44bb-8d27-77b4de1d254b', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:03:19.251221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:03:19.251825 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:03:19.252103 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:03:19.252542 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:03:19.253158 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:03:19.262938 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:19.263521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:19.264323 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:19.264784 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:19.283083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Getting quotas for project 5d906ca8441643369eacf6255bcacf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:03:19.288386 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Getting quotas for user ae6e7a6e3cc949d9b83e4be12e4bab98 and project 5d906ca8441643369eacf6255bcacf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:03:19.305838 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:03:19.308267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:03:19.357876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0a2be079-49b5-4cdd-a47a-bbeecb25a994 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788980 Jul 20 22:03:19.367495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 519/1090] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 22:03:19.371464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-6dcd5364-c6a1-4c18-859b-05812efd05da tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:19.372032 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-6dcd5364-c6a1-4c18-859b-05812efd05da tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:19.488390 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-6dcd5364-c6a1-4c18-859b-05812efd05da tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:19.495714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-6dcd5364-c6a1-4c18-859b-05812efd05da tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1219 microversion: 2.1 time: 0.129855 Jul 20 22:03:19.496520 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 572/1091] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:19 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:19.677261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:19.678665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:19.687545 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:19.688056 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:19.688942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:19.689387 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:19.853687 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:19.870057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e2f19cb8-60b3-49bd-9e54-b97f0fd2c0be tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.198680 Jul 20 22:03:19.871032 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 520/1092] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:19 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:20.522264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:20.522264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:20.537090 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:20.538842 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:20.539669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:20.540111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:20.643848 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:20.653277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2b67cd5d-ddd5-4279-8337-4c39884a4dbc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1279 microversion: 2.1 time: 0.138838 Jul 20 22:03:20.654602 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 573/1093] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:20 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:20.888946 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:20.890206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:20.899388 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:20.900155 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:20.901136 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:20.901779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:21.199807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:21.208385 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-08254dbc-4070-490d-b25f-d829c0e55bde tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.323758 Jul 20 22:03:21.209626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 521/1094] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:20 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:21.672298 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:21.672988 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:21.682285 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:21.682739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:21.683574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:21.684009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:21.943525 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:21.951327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a815fe84-52c0-491c-8548-08afc17958c4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.283079 Jul 20 22:03:21.951939 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 574/1095] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:21 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:22.225807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:22.226701 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:22.233543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:22.233997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:22.234771 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:22.235449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:22.462607 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-1ee3f8a3-9b4c-4e98-b173-023be9de2fe7 req-085cee77-a11f-4654-a3cf-771f1981cf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6fc4ff-263d-4efa-a091-eb03d10243ac", "tag": "85a9fe6d-511f-44ce-bd66-ea63ece52115"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:22.471363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1ee3f8a3-9b4c-4e98-b173-023be9de2fe7 req-085cee77-a11f-4654-a3cf-771f1981cf8d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:22.472060 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-1ee3f8a3-9b4c-4e98-b173-023be9de2fe7 req-085cee77-a11f-4654-a3cf-771f1981cf8d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:22.487255 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-1ee3f8a3-9b4c-4e98-b173-023be9de2fe7 req-085cee77-a11f-4654-a3cf-771f1981cf8d service nova] Creating event network-changed:85a9fe6d-511f-44ce-bd66-ea63ece52115 for instance ac6fc4ff-263d-4efa-a091-eb03d10243ac on hv-cinder-84969 Jul 20 22:03:22.494411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-1ee3f8a3-9b4c-4e98-b173-023be9de2fe7 req-085cee77-a11f-4654-a3cf-771f1981cf8d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036678 Jul 20 22:03:22.495612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 575/1096] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:03:22.563567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:22.571099 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ce25fed8-3626-468e-abfd-944f1c3aba0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.349090 Jul 20 22:03:22.580698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 522/1097] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:22 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:22.970593 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:22.971368 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:22.980442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:22.980442 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:22.980788 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:22.981148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:23.131336 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:23.139195 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-479681eb-1877-488e-9be5-3c73fe3b7fa7 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.173419 Jul 20 22:03:23.139789 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 576/1098] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:22 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:23.588107 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:23.588718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:23.595237 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:23.595691 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:23.596447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:23.596878 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:23.771154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:23.780122 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fb4fa89b-6083-46b0-bee9-973437b14820 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.196137 Jul 20 22:03:23.781180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 523/1099] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:23 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:24.156841 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:24.157671 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:24.164794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:24.165246 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:24.166103 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:24.166543 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:24.419418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:24.427363 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9454e609-4eca-4ab2-82fd-cfe7d395aea0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.274551 Jul 20 22:03:24.428917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 577/1100] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:24 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:24.797783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:24.798398 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:24.806099 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:24.806565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:24.807409 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:24.807856 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:24.961270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:24.969938 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-81c1f8cf-f28b-429b-a259-dfbe760e7be5 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.175858 Jul 20 22:03:24.970531 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 524/1101] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:24 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:25.445627 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:25.446235 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:25.455248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:25.455248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:25.455248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:25.455248 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:25.626175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:25.635048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-62e3ac83-11e4-422e-9a7e-7ab67eb3d191 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.193500 Jul 20 22:03:25.635625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 578/1102] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:25 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:25.987933 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:25.988796 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:25.998500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:25.998947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:26.000043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:26.000453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:26.163399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:26.174290 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2873d77f-218b-4a0c-89c5-ab6f8d2e4d46 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.190775 Jul 20 22:03:26.174891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 525/1103] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:25 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:26.654083 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:26.654707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:26.661477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:26.663664 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:26.663998 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:26.664890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:26.813643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:26.822125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5fceb6d0-c9f2-4c14-ad43-99b2cfeba15b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.172135 Jul 20 22:03:26.822716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 579/1104] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:26 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:27.191219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:27.191875 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:27.199858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:27.200149 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:27.200919 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:27.201351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:27.355087 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:27.362711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-401920c4-f94c-4b62-a187-c095baacf4ea tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.175287 Jul 20 22:03:27.363324 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 526/1105] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:27 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:27.845400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:27.846030 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:27.853869 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:27.854335 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:27.855225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:27.855657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:28.000377 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:28.008765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-08a375f1-9c13-4a91-bb16-1aba35b377f5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.167126 Jul 20 22:03:28.009356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 580/1106] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:27 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:28.384206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:28.384206 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:28.389261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:28.389730 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:28.390508 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:28.390947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:28.559834 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:28.567631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-fb68e2bc-ae1d-491f-a44f-10741a9fd825 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.190058 Jul 20 22:03:28.568257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 527/1107] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:28 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:28.606225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-68a9d5af-1213-479b-b809-6117ff208034 req-8da861de-84fa-4b73-8444-771e6b734faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6fc4ff-263d-4efa-a091-eb03d10243ac", "name": "network-vif-plugged", "status": "completed", "tag": "85a9fe6d-511f-44ce-bd66-ea63ece52115"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:28.615911 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68a9d5af-1213-479b-b809-6117ff208034 req-8da861de-84fa-4b73-8444-771e6b734faf service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:28.616603 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-68a9d5af-1213-479b-b809-6117ff208034 req-8da861de-84fa-4b73-8444-771e6b734faf service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:28.628501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-68a9d5af-1213-479b-b809-6117ff208034 req-8da861de-84fa-4b73-8444-771e6b734faf service nova] Creating event network-vif-plugged:85a9fe6d-511f-44ce-bd66-ea63ece52115 for instance ac6fc4ff-263d-4efa-a091-eb03d10243ac on hv-cinder-84969 Jul 20 22:03:28.634085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-68a9d5af-1213-479b-b809-6117ff208034 req-8da861de-84fa-4b73-8444-771e6b734faf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Jul 20 22:03:28.634797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 581/1108] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:03:29.027468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:29.028077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:29.034456 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:29.034904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:29.035708 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:29.036139 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:29.179217 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:29.187039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3d0e6bff-f69d-477e-b4fc-225bfc164a6e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.163554 Jul 20 22:03:29.187654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 528/1109] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:29 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:29.582962 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:29.588092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:29.588791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:29.596976 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:29.597419 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:29.598186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:29.598612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:29.747489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:29.755596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-567ba36e-4cb2-43e8-9b65-c583e323f42e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.173875 Jul 20 22:03:29.756392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 582/1110] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:29 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:30.206329 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:30.206936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:30.209755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:30.210270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:30.216746 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:30.217191 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:30.217951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:30.218380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:30.364870 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:30.372997 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-de8f9527-d3cc-4af6-a0f4-7907630f38bd tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1319 microversion: 2.1 time: 0.170500 Jul 20 22:03:30.374397 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 529/1111] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:30 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:30.773515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:30.774132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:30.780915 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:30.781293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:30.782065 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:30.782503 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:30.943966 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:30.954823 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e91ce539-ae70-4aa3-beb5-586a2edc98a0 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.185744 Jul 20 22:03:30.960902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 583/1112] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:30 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:31.392182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:31.392806 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:31.400369 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:31.400859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:31.401621 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:31.404003 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:31.563221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:31.572282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-e800d4da-4626-4b1b-bf5f-48d3fa3e59f6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1507 microversion: 2.1 time: 0.183945 Jul 20 22:03:31.579509 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 530/1113] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:31 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:31.974883 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:31.976313 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:31.985860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:31.986362 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:31.987384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:31.987849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:32.157571 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:32.165537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f4b7a2d5-e97d-4f9a-8877-4726686084d2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.195958 Jul 20 22:03:32.166112 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 584/1114] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:31 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:33.182547 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:33.183304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:33.190734 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:33.191255 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:33.192051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:33.192496 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:33.635794 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:33.644449 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a237e343-505d-4f5f-a69a-8e15d5cb8bf4 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.465869 Jul 20 22:03:33.645045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 531/1115] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:33 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:34.663470 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:34.664124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:34.670777 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:34.671276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:34.672062 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:34.672496 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:34.811334 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:34.819642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f851bd55-6968-4c47-8702-99af6529a6b3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.160147 Jul 20 22:03:34.820234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 585/1116] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:34 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:35.838868 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:35.840019 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:35.846738 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:35.847313 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:35.848052 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:35.848490 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:35.994733 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:36.003045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4542e81f-b26f-406d-ae5f-ab7875849dba tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.170760 Jul 20 22:03:36.003651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 532/1117] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:35 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:37.020895 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:37.022192 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:37.029283 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:37.029728 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:37.030494 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:37.030922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:37.175226 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:37.187293 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e6bd00a5-dc31-414e-8afe-9b9c505178b2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.169852 Jul 20 22:03:37.187906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 586/1118] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:37 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:38.205583 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:38.206166 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:38.214095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.214603 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.215407 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.215845 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.218640 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:38.370257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:38.378665 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8de223e6-1761-4055-894e-983544eb723c tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1507 microversion: 2.1 time: 0.177052 Jul 20 22:03:38.379296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 533/1119] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:38 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:38.395042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:38.395773 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:38.412701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.413695 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.414491 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.414931 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.494120 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-486e0ba1-adad-4543-9c16-26364b7988e8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "POST /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22/action" status: 202 len: 0 microversion: 2.1 time: 0.103026 Jul 20 22:03:38.497912 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 587/1120] 10.222.0.86 () {60 vars in 1277 bytes} [Wed Jul 20 22:03:38 2022] POST /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:03:38.503787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:38.504552 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:38.512970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.513747 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.514713 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:38.515203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:38.664062 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:38.671926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-95dc0a2b-8233-4f40-867e-c83585d8dd5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1515 microversion: 2.1 time: 0.172391 Jul 20 22:03:38.672370 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 534/1121] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:38 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:39.690874 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:39.691601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:39.698463 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:39.698907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:39.699712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:39.700142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:39.844186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:39.847908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:39.853400 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-fbca0ae9-3bbe-4529-b93b-7e7222256a66 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1517 microversion: 2.1 time: 0.167354 Jul 20 22:03:39.853994 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 588/1122] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:39 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:40.607829 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-1683ecbb-1794-4950-b445-cb91a68f4c4c req-82942379-12f7-4d05-8eaa-b9a152e2e2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "name": "network-vif-unplugged", "status": "completed", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:40.619909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-1683ecbb-1794-4950-b445-cb91a68f4c4c req-82942379-12f7-4d05-8eaa-b9a152e2e2e9 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:40.620626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-1683ecbb-1794-4950-b445-cb91a68f4c4c req-82942379-12f7-4d05-8eaa-b9a152e2e2e9 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:40.638365 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-1683ecbb-1794-4950-b445-cb91a68f4c4c req-82942379-12f7-4d05-8eaa-b9a152e2e2e9 service nova] Creating event network-vif-unplugged:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:03:40.645038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-1683ecbb-1794-4950-b445-cb91a68f4c4c req-82942379-12f7-4d05-8eaa-b9a152e2e2e9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040907 Jul 20 22:03:40.645657 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 535/1123] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:03:40.872791 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:40.873467 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:40.882129 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:40.882592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:40.883397 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:40.884007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:41.104608 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:41.116764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-acab992e-d258-49cf-9e9c-7abd592b4074 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.248536 Jul 20 22:03:41.117364 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 589/1124] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:40 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:42.140499 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:42.141227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:42.150662 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:42.151164 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:42.151958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:42.152443 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:42.310543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:42.319951 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1d0c22bc-471c-43fb-b94c-f20e5d6e1f86 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.186188 Jul 20 22:03:42.320632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 536/1125] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:42 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:43.337946 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:43.338514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:43.345411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:43.345978 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:43.346760 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:43.347240 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:43.487498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:43.496787 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-227714b2-18bc-4933-946a-45cb1c9df732 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.163242 Jul 20 22:03:43.497421 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 590/1126] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:43 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:03:44.515212 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:44.515888 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:44.522661 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:44.523327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:44.524113 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:44.524558 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:44.682953 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:44.690773 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-36439917-a3b6-470c-b6ce-d898238a505a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.179443 Jul 20 22:03:44.691384 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 537/1127] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:44 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:45.708489 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:45.709123 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:45.715646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:45.716100 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:45.716857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:45.717695 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:45.860644 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:45.869301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8727167b-c72d-4d32-a72a-a9d933d734fa tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.164631 Jul 20 22:03:45.869881 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 591/1128] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:45 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:46.887625 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:46.888241 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:46.894433 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:46.894892 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:46.895941 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:46.896508 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:47.035349 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:47.043278 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-851ecee8-0650-4369-aa37-20ca6ab01a5e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.159483 Jul 20 22:03:47.043962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 538/1129] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:46 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:48.063750 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:48.064331 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:48.073046 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:48.073493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:48.074264 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:48.074692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:48.257680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:48.267095 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-461c3970-4f68-440a-9800-665d7bc1902e tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.207283 Jul 20 22:03:48.267681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 592/1130] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:48 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:49.285515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:49.286211 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:49.288811 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:49.294452 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:49.294905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:49.295704 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:49.296129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:49.433897 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:49.441517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-28feaa6b-1c21-47c0-8ad1-6231e349a7f3 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.159855 Jul 20 22:03:49.442095 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 539/1131] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:49 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:50.460657 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:50.461259 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:50.463284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=49 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:50.468497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:50.468944 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:50.469709 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:50.470169 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:50.613800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:50.621472 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-832a6f1c-f595-4c9e-8781-868fcb9889a1 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.165458 Jul 20 22:03:50.622281 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 593/1132] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:50 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:51.638879 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:51.639599 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:51.646809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:51.647280 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:51.648048 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:51.648478 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:51.785809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:51.798119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-12231cad-e6ec-444e-9670-fa588ba32f99 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.162904 Jul 20 22:03:51.798821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 540/1133] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:51 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:52.728519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-bf3f807c-5b96-475d-856d-b9341a366f00 req-a2f3ad39-3559-4470-83ec-ff3bc3246bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "name": "network-vif-plugged", "status": "completed", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:52.737296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-bf3f807c-5b96-475d-856d-b9341a366f00 req-a2f3ad39-3559-4470-83ec-ff3bc3246bd8 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:52.737747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-bf3f807c-5b96-475d-856d-b9341a366f00 req-a2f3ad39-3559-4470-83ec-ff3bc3246bd8 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:52.752722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-bf3f807c-5b96-475d-856d-b9341a366f00 req-a2f3ad39-3559-4470-83ec-ff3bc3246bd8 service nova] Creating event network-vif-plugged:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:03:52.759319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-bf3f807c-5b96-475d-856d-b9341a366f00 req-a2f3ad39-3559-4470-83ec-ff3bc3246bd8 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Jul 20 22:03:52.760343 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 594/1134] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:03:52.816882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:52.817628 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:52.824238 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:52.824690 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:52.825471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:52.825910 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:52.973094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:52.984587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c28a1fde-82ca-4b28-baf1-26116f43fe0f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.171904 Jul 20 22:03:52.985180 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 541/1135] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:52 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:54.004996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:54.005691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:54.012092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:54.012537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:54.013296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:54.013726 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:54.156914 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:54.165876 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b5fca162-6e6a-4fdd-95bc-449e3aa7a8bb tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1573 microversion: 2.1 time: 0.165979 Jul 20 22:03:54.166471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 595/1136] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:53 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:03:54.200947 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5d70a1c-a344-4c27-84ae-4b1c9898b2a5", "device": "/dev/sdb"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:03:54.202506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:54.209896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:54.210353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:54.211154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:54.211593 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:54.663906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-565a6840-a77e-4a96-b0aa-fa30005143bc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "POST /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466918 Jul 20 22:03:54.664632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 542/1137] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:03:54 2022] POST /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:03:55.182857 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:03:55.183479 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:03:55.190265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:55.190712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:55.191551 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:03:55.192082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:03:55.335438 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:03:55.343093 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-1d1722f4-bc61-4dd9-a007-27ff1c2ba767 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1560 microversion: 2.1 time: 0.164097 Jul 20 22:03:55.343722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 596/1138] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:03:55 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:19.440389 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=7 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:19.441155 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:19.446590 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:19.447208 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:19.455431 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:19.455877 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:19.456645 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:19.457083 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:19.541991 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lazy-loading 'services' on Instance uuid ac6fc4ff-263d-4efa-a091-eb03d10243ac {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:04:19.615777 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-0eb54e13-abdb-4096-99fa-e7823063c094 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac/os-volume_attachments/f5d70a1c-a344-4c27-84ae-4b1c9898b2a5" status: 202 len: 0 microversion: 2.1 time: 0.176651 Jul 20 22:04:19.616378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 543/1139] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:04:19 2022] DELETE /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac/os-volume_attachments/f5d70a1c-a344-4c27-84ae-4b1c9898b2a5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:04:20.739993 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:20.740600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:20.742877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=7 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:20.743583 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=44 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:20.749862 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:20.750314 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:20.751118 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:20.751559 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:20.785824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:04:20.869612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b0ec7b28-0df9-440d-80df-f53668d35077 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 204 len: 0 microversion: 2.1 time: 0.133440 Jul 20 22:04:20.870233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 597/1140] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:04:20 2022] DELETE /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:04:20.881948 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:20.882664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:20.889160 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:20.889711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:20.890605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:20.891047 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:21.036340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:21.044614 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6305572c-d451-4518-9cd5-fd6ab38daf65 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1513 microversion: 2.1 time: 0.169300 Jul 20 22:04:21.045194 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 544/1141] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:20 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:22.063267 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:22.063964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:22.072165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:22.072619 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:22.073401 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:22.073840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:22.222768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:22.232887 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d173a906-978c-468c-8fff-ccd684e112b5 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1513 microversion: 2.1 time: 0.173813 Jul 20 22:04:22.233465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 598/1142] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:22 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:23.250511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:23.251158 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:23.258775 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:23.259267 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:23.260045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:23.260485 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:23.394450 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:23.403602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-71370cc0-9f37-445c-aef0-cd9eaffed9e9 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1513 microversion: 2.1 time: 0.157143 Jul 20 22:04:23.404196 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 545/1143] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:23 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:24.274153 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-f1236b92-3e4a-4c69-80c6-aed364f26356 req-54250f54-cde7-4748-b048-bcc4f5bcbf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6fc4ff-263d-4efa-a091-eb03d10243ac", "name": "network-vif-deleted", "tag": "85a9fe6d-511f-44ce-bd66-ea63ece52115"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:04:24.282325 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-f1236b92-3e4a-4c69-80c6-aed364f26356 req-54250f54-cde7-4748-b048-bcc4f5bcbf48 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:24.282761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-f1236b92-3e4a-4c69-80c6-aed364f26356 req-54250f54-cde7-4748-b048-bcc4f5bcbf48 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:24.295102 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-f1236b92-3e4a-4c69-80c6-aed364f26356 req-54250f54-cde7-4748-b048-bcc4f5bcbf48 service nova] Creating event network-vif-deleted:85a9fe6d-511f-44ce-bd66-ea63ece52115 for instance ac6fc4ff-263d-4efa-a091-eb03d10243ac on hv-cinder-84969 Jul 20 22:04:24.300430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-f1236b92-3e4a-4c69-80c6-aed364f26356 req-54250f54-cde7-4748-b048-bcc4f5bcbf48 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236301 Jul 20 22:04:24.301072 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 599/1144] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:04:24.421826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:24.422425 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:24.430782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:24.430782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:24.430782 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:24.431378 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:24.465126 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:24.465575 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:24.466036 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.objects.instance [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lazy-loading 'fault' on Instance uuid ac6fc4ff-263d-4efa-a091-eb03d10243ac {{(pid=124150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:04:24.511447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:24.519363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bad0628c-57da-4fff-b51a-b06d34f1b08f tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 200 len: 1309 microversion: 2.1 time: 0.101272 Jul 20 22:04:24.520721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 546/1145] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:24 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:25.538898 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:25.539646 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: ac6fc4ff-263d-4efa-a091-eb03d10243ac] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:25.546389 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:25.546860 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:25.547652 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:25.548079 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:25.562739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] HTTP exception thrown: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Request method failure captured: Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac HTTP/1.1 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hukz_W66gw26TwFLIsMU7AXXm4qrT0Cx3tVgVN-swhu7aDbBfqQETVCAnNgA2fNDcA2HmXupML33io8pWyq5lORy3lC3pgErXHxhyRBpWiOGdSQLVmIccjSvEMcEsHvIy5H20PFz5YrewYhpF8KvHfil5wOFhB4mqBkwQ1QgZ-SAn0 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 5d906ca8441643369eacf6255bcacf3e Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:04:25.564410 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d906ca8441643369eacf6255bcacf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d906ca8441643369eacf6255bcacf3e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d906ca8441643369eacf6255bcacf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d906ca8441643369eacf6255bcacf3e"}]}] Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 5d906ca8441643369eacf6255bcacf3e Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesSnapshotTestJSON-1532435781-project Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: ae6e7a6e3cc949d9b83e4be12e4bab98 Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesSnapshotTestJSON-1532435781-project Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. Jul 20 22:04:25.566167 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'ac6fc4ff-263d-4efa-a091-eb03d10243ac'} Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:04:25.567127 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. Jul 20 22:04:25.568572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:04:25.569764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Returning 404 to user: Instance ac6fc4ff-263d-4efa-a091-eb03d10243ac could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:04:25.569764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ba9433ac-4eec-48ad-afb3-e3f541e74832 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac" status: 404 len: 111 microversion: 2.1 time: 0.031706 Jul 20 22:04:25.569764 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 600/1146] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:25 2022] GET /compute/v2.1/servers/ac6fc4ff-263d-4efa-a091-eb03d10243ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:04:35.488799 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-104225412", "imageRef": "c41d28ab-f4e4-4785-be36-4e8d208cd932", "flavorRef": "452", "networks": [{"uuid": "96cc28b4-a280-44bb-8d27-77b4de1d254b"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:04:35.496473 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=10 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:35.497151 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:35.545923 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] validate_networks() for [('96cc28b4-a280-44bb-8d27-77b4de1d254b', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:04:36.008974 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:04:36.009654 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:04:36.010428 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:04:36.011080 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:04:36.011807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:04:36.022334 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:36.022776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:36.023625 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:36.024043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:36.041401 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Getting quotas for project 5d906ca8441643369eacf6255bcacf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:04:36.045396 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Getting quotas for user ae6e7a6e3cc949d9b83e4be12e4bab98 and project 5d906ca8441643369eacf6255bcacf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:04:36.056604 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:04:36.058858 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c41d28ab-f4e4-4785-be36-4e8d208cd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:04:36.108346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-af4afacf-0180-4a28-b1e6-0a9a2a4fb9c0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623915 Jul 20 22:04:36.109333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 547/1147] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:04:36.122191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d5205ef7-7625-4e69-accf-d7fc6a66d559 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:36.122807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d5205ef7-7625-4e69-accf-d7fc6a66d559 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:36.125733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:36.126402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:36.186426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d5205ef7-7625-4e69-accf-d7fc6a66d559 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:36.193730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d5205ef7-7625-4e69-accf-d7fc6a66d559 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1218 microversion: 2.1 time: 0.077434 Jul 20 22:04:36.194321 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 601/1148] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:36 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:04:37.210758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:37.211504 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:37.220801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:37.221261 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:37.222046 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:37.222500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:37.337680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:37.346576 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-bf2e7380-1092-4f9b-85d7-e00a3a6e66a0 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1278 microversion: 2.1 time: 0.139856 Jul 20 22:04:37.347543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 548/1149] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:37 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:04:38.365600 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:38.366225 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:38.373902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:38.374358 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:38.375430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:38.375878 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:38.594827 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:38.602800 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-9fe52cb1-fa82-4bec-9c80-218d50b41ea6 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.241631 Jul 20 22:04:38.603522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 602/1150] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:38 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:38.744781 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-027b2beb-d761-42e2-bd02-4097a03bde9e req-77ea2d98-6b22-4309-9a72-84e7d388bfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c114bb-c765-45ec-8cec-7b712b417dc1", "tag": "ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:04:38.773522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-027b2beb-d761-42e2-bd02-4097a03bde9e req-77ea2d98-6b22-4309-9a72-84e7d388bfb6 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:38.774277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-027b2beb-d761-42e2-bd02-4097a03bde9e req-77ea2d98-6b22-4309-9a72-84e7d388bfb6 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:38.787803 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-027b2beb-d761-42e2-bd02-4097a03bde9e req-77ea2d98-6b22-4309-9a72-84e7d388bfb6 service nova] Creating event network-changed:ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca for instance f5c114bb-c765-45ec-8cec-7b712b417dc1 on hv-cinder-84969 Jul 20 22:04:38.794333 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-027b2beb-d761-42e2-bd02-4097a03bde9e req-77ea2d98-6b22-4309-9a72-84e7d388bfb6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053179 Jul 20 22:04:38.795097 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 549/1151] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:04:39.621919 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:39.622534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:39.630044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:39.630498 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:39.631309 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:39.631746 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:39.767332 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:39.778462 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4410dff7-03e9-4c97-8123-2139d9efaf19 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.160604 Jul 20 22:04:39.779044 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 603/1152] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:39 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:40.796880 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:40.797577 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:40.804549 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:40.804921 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:40.805694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:40.806121 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:40.948321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:40.956213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-22f50978-9c91-40d4-a4df-1eccd3252661 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.163915 Jul 20 22:04:40.956807 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 550/1153] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:40 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:41.977745 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:41.978411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:41.985007 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:41.985457 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:41.986234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:41.986668 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:42.123761 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:42.132142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-3b5a3e86-c4bc-4ddb-97ef-5de7af5f93a4 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.158223 Jul 20 22:04:42.132722 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 604/1154] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:41 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:42.264529 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:04:42.264805 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:04:43.149986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:43.150706 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:43.157909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:43.158364 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:43.159189 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:43.159630 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:43.308538 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:43.317123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-05a07808-bb7e-47b3-a929-ae648457b66e tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.170542 Jul 20 22:04:43.317717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 551/1155] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:43 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:44.334833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:44.335674 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:44.342199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:44.342650 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:44.343538 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:44.343891 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:44.486251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:44.493753 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b0b21606-3722-4e84-9a23-6113f040c8ec tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.163507 Jul 20 22:04:44.494327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 605/1156] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:44 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:45.338410 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-6f71ad20-7501-43ea-b74f-2659592de123 req-7b9b5c52-436d-49a3-b957-25e1fb36f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c114bb-c765-45ec-8cec-7b712b417dc1", "name": "network-vif-plugged", "status": "completed", "tag": "ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:04:45.346327 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6f71ad20-7501-43ea-b74f-2659592de123 req-7b9b5c52-436d-49a3-b957-25e1fb36f9f0 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:45.346810 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-6f71ad20-7501-43ea-b74f-2659592de123 req-7b9b5c52-436d-49a3-b957-25e1fb36f9f0 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:45.359296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-6f71ad20-7501-43ea-b74f-2659592de123 req-7b9b5c52-436d-49a3-b957-25e1fb36f9f0 service nova] Creating event network-vif-plugged:ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca for instance f5c114bb-c765-45ec-8cec-7b712b417dc1 on hv-cinder-84969 Jul 20 22:04:45.365094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-6f71ad20-7501-43ea-b74f-2659592de123 req-7b9b5c52-436d-49a3-b957-25e1fb36f9f0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104743 Jul 20 22:04:45.365721 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 552/1157] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:04:45.511623 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:45.512318 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:45.520041 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:45.520504 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:45.521964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:45.522637 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:45.708943 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:45.716675 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f73227e0-6220-4688-a0b5-a495049b0bfc tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.209667 Jul 20 22:04:45.717276 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 606/1158] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:45 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:46.735203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:46.735906 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:46.737891 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:46.738565 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:46.745622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:46.746076 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:46.746854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:46.747319 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:46.891163 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:46.899185 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c045e917-14da-4c56-b9e6-d4778cf2a3fa tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1318 microversion: 2.1 time: 0.168387 Jul 20 22:04:46.899624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 553/1159] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:46 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:47.915796 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:04:47.916771 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:47.919187 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:47.925517 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:47.925964 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:47.926739 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:47.927205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:48.063659 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:04:48.072347 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ff6a4468-479d-4939-8525-08964d677514 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1507 microversion: 2.1 time: 0.160927 Jul 20 22:04:48.072934 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 607/1160] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:04:47 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:04:48.089420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32f38f00-c477-49df-a179-e3ac00a80075", "device": "/dev/sdb"}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:04:48.090559 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:04:48.097399 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:48.097854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:48.098626 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:04:48.099602 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:04:48.366790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6ea6aedd-840e-4e77-9274-3bf42d3c35f3 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "POST /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281264 Jul 20 22:04:48.367455 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 554/1161] 10.222.0.86 () {60 vars in 1322 bytes} [Wed Jul 20 22:04:48 2022] POST /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:05:07.756533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:07.757116 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:07.759043 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=16 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:07.759768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=36 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:07.765697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:07.766139 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:07.766901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:07.767359 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:07.852284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.objects.instance [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lazy-loading 'services' on Instance uuid f5c114bb-c765-45ec-8cec-7b712b417dc1 {{(pid=124151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:05:07.926300 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f4875089-885f-4185-a532-1f0b2332e944 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1/os-volume_attachments/32f38f00-c477-49df-a179-e3ac00a80075" status: 202 len: 0 microversion: 2.1 time: 0.173620 Jul 20 22:05:07.927029 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 608/1162] 10.222.0.86 () {58 vars in 1415 bytes} [Wed Jul 20 22:05:07 2022] DELETE /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1/os-volume_attachments/32f38f00-c477-49df-a179-e3ac00a80075 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:05:09.040578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:09.041366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:09.045817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:09.046418 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:09.055818 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:09.056275 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:09.057062 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:09.057511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:09.086884 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:05:09.175356 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-277cbac4-1fc6-4656-a204-13301cc5e4d8 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 204 len: 0 microversion: 2.1 time: 0.135688 Jul 20 22:05:09.176282 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 555/1163] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:05:09 2022] DELETE /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:05:09.185319 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:09.186136 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:09.193640 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:09.194092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:09.194876 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:09.195348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:09.335578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:09.343271 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-55439967-0f4a-46f9-8acd-1cf74707e927 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1513 microversion: 2.1 time: 0.162202 Jul 20 22:05:09.343945 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 609/1164] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:09 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:05:10.363425 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:10.364232 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:10.371648 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:10.372106 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:10.372911 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:10.373351 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:10.509973 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:10.517647 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-2a38e410-c878-4d0d-a457-abcbc25a7e8b tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1513 microversion: 2.1 time: 0.158533 Jul 20 22:05:10.518221 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 556/1165] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:10 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:05:11.535233 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:11.535870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:11.542539 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:11.542987 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:11.543868 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:11.544311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:11.992663 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e7a6e3cc949d9b83e4be12e4bab98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d906ca8441643369eacf6255bcacf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:12.000669 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b102bdd4-5c17-4c0e-a166-6a99ff8c2230 tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 200 len: 1513 microversion: 2.1 time: 0.469439 Jul 20 22:05:12.001234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 610/1166] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:11 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 1513 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:05:12.434555 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-8a04e573-1deb-41c6-89c4-02e5d3e4bcaa req-2c04aaeb-5598-437e-a979-4e6f4a03c940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c114bb-c765-45ec-8cec-7b712b417dc1", "name": "network-vif-deleted", "tag": "ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:05:12.443633 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-8a04e573-1deb-41c6-89c4-02e5d3e4bcaa req-2c04aaeb-5598-437e-a979-4e6f4a03c940 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:12.444092 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-8a04e573-1deb-41c6-89c4-02e5d3e4bcaa req-2c04aaeb-5598-437e-a979-4e6f4a03c940 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:12.455804 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-8a04e573-1deb-41c6-89c4-02e5d3e4bcaa req-2c04aaeb-5598-437e-a979-4e6f4a03c940 service nova] Creating event network-vif-deleted:ceab4fb6-0ae0-42a8-a196-86e3fb6d3bca for instance f5c114bb-c765-45ec-8cec-7b712b417dc1 on hv-cinder-84969 Jul 20 22:05:12.461688 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-8a04e573-1deb-41c6-89c4-02e5d3e4bcaa req-2c04aaeb-5598-437e-a979-4e6f4a03c940 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Jul 20 22:05:12.462613 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 557/1167] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:05:13.017735 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:13.018353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] [instance: f5c114bb-c765-45ec-8cec-7b712b417dc1] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:13.025356 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:13.025810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:13.026592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:13.027024 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:13.041680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] HTTP exception thrown: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Request method failure captured: Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 HTTP/1.1 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hukz_W66gw26TwFLIsMU7AXXm4qrT0Cx3tVgVN-swhu7aDbBfqQETVCAnNgA2fNDcA2HmXupML33io8pWyq5lORy3lC3pgErXHxhyRBpWiOGdSQLVmIccjSvEMcEsHvIy5H20PFz5YrewYhpF8KvHfil5wOFhB4mqBkwQ1QgZ-SAn0 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 5d906ca8441643369eacf6255bcacf3e Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:05:13.043379 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d906ca8441643369eacf6255bcacf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d906ca8441643369eacf6255bcacf3e", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d906ca8441643369eacf6255bcacf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d906ca8441643369eacf6255bcacf3e"}]}] Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 5d906ca8441643369eacf6255bcacf3e Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1532435781 Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-VolumesSnapshotTestJSON-1532435781-project Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: ae6e7a6e3cc949d9b83e4be12e4bab98 Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-VolumesSnapshotTestJSON-1532435781-project Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. Jul 20 22:05:13.045156 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'f5c114bb-c765-45ec-8cec-7b712b417dc1'} Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:05:13.046122 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. Jul 20 22:05:13.047768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:13.049178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] Returning 404 to user: Instance f5c114bb-c765-45ec-8cec-7b712b417dc1 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:05:13.049178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-26dd9114-01dd-4e26-8592-73a9670a626d tempest-VolumesSnapshotTestJSON-1532435781 tempest-VolumesSnapshotTestJSON-1532435781-project] 10.222.0.86 "GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1" status: 404 len: 111 microversion: 2.1 time: 0.030997 Jul 20 22:05:13.049178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 611/1168] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:13 2022] GET /compute/v2.1/servers/f5c114bb-c765-45ec-8cec-7b712b417dc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:05:28.834353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:28.835314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:28.839675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:28.840306 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:28.849558 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:28.850051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=8 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:28.851384 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:28.852315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:28.852476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:28.852917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:28.882905 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Going to try to terminate instance {{(pid=124150) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:05:28.916124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-dbbd87a3-7555-4988-8eb2-15e511d49343 req-eb1ddfce-e9d3-4414-87b0-c231d5d4bb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:05:28.926186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-dbbd87a3-7555-4988-8eb2-15e511d49343 req-eb1ddfce-e9d3-4414-87b0-c231d5d4bb30 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:28.926186 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-dbbd87a3-7555-4988-8eb2-15e511d49343 req-eb1ddfce-e9d3-4414-87b0-c231d5d4bb30 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:28.938907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-dbbd87a3-7555-4988-8eb2-15e511d49343 req-eb1ddfce-e9d3-4414-87b0-c231d5d4bb30 service nova] Creating event network-changed:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:05:28.944733 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-dbbd87a3-7555-4988-8eb2-15e511d49343 req-eb1ddfce-e9d3-4414-87b0-c231d5d4bb30 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107740 Jul 20 22:05:28.945413 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 612/1169] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:05:28.975467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-6cba5816-afb8-469d-854d-832fcc880d5b tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "DELETE /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 204 len: 0 microversion: 2.1 time: 0.142900 Jul 20 22:05:28.976467 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 558/1170] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:05:28 2022] DELETE /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:05:28.988232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:28.989265 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:28.996402 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:28.996854 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:28.997844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:28.998284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:29.144392 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:29.153836 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e8c33e89-39da-4cfb-87be-6c9ac4ccacf7 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.170302 Jul 20 22:05:29.154431 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 613/1171] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:28 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:05:30.172820 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:30.173454 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:30.180024 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:30.180477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:30.181277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:30.181712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:30.312882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:30.320466 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-55205c7f-aa48-4802-bdfd-d6519a1a6b1f tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1566 microversion: 2.1 time: 0.151931 Jul 20 22:05:30.321037 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 559/1172] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:30 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:05:31.337704 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:31.338405 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:31.345188 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:31.345643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:31.346418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:31.346865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:31.598074 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-a3dc0e4d-d015-4c75-bbbf-6da3a33553f7 req-d8ef3547-7b21-426c-a7f1-09c234474850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fdc2f-4dfc-44de-809c-70086990db22", "name": "network-vif-deleted", "tag": "fc82c8b5-4037-4192-aa89-f5f517567d41"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:05:31.605684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9257cf9254b82a2b9fa5ee41243be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f83ca7e7fc844f180ae057a576f3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:05:31.607609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a3dc0e4d-d015-4c75-bbbf-6da3a33553f7 req-d8ef3547-7b21-426c-a7f1-09c234474850 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:31.608136 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a3dc0e4d-d015-4c75-bbbf-6da3a33553f7 req-d8ef3547-7b21-426c-a7f1-09c234474850 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:31.616715 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-da2e06b2-9331-49e6-8532-3b903f2331f8 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 200 len: 1447 microversion: 2.1 time: 0.282855 Jul 20 22:05:31.617564 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 614/1173] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:31 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 1447 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:05:31.621034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-a3dc0e4d-d015-4c75-bbbf-6da3a33553f7 req-d8ef3547-7b21-426c-a7f1-09c234474850 service nova] Creating event network-vif-deleted:fc82c8b5-4037-4192-aa89-f5f517567d41 for instance 502fdc2f-4dfc-44de-809c-70086990db22 on hv-cinder-84969 Jul 20 22:05:31.627591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-a3dc0e4d-d015-4c75-bbbf-6da3a33553f7 req-d8ef3547-7b21-426c-a7f1-09c234474850 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Jul 20 22:05:31.628316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 560/1174] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:05:32.635566 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:32.636109 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] [instance: 502fdc2f-4dfc-44de-809c-70086990db22] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:05:32.642636 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:32.643106 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:32.643899 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:05:32.644468 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:05:32.658237 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] HTTP exception thrown: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Request method failure captured: Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 HTTP/1.1 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hrj1Jx_7y_G9JK9Ks9PVjsKIRICkOmjQ5n3ez3ziwBGWMUlhxsN2r6XvOcI-GHC6pfcw0bttnRFz9HEEv5LI-i-UjFqHFACT4E4er_7VVTsOc3ZVAmoVI2u8yZYn0QRQHVDAJOJMiWipWdPQitHZYZtgPgBIQYbiJWLWP0xL0ZrpGw Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: 2f83ca7e7fc844f180ae057a576f3723 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-TestShelveInstance-2016105005 Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:05:32.659913 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/2f83ca7e7fc844f180ae057a576f3723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_2f83ca7e7fc844f180ae057a576f3723", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/2f83ca7e7fc844f180ae057a576f3723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/2f83ca7e7fc844f180ae057a576f3723"}]}] Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-TestShelveInstance-2016105005 Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: 2f83ca7e7fc844f180ae057a576f3723 Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-TestShelveInstance-2016105005 Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-TestShelveInstance-2016105005-project Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 24c9257cf9254b82a2b9fa5ee41243be Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-TestShelveInstance-2016105005-project Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. Jul 20 22:05:32.661768 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': '502fdc2f-4dfc-44de-809c-70086990db22'} Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:05:32.662824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. Jul 20 22:05:32.664577 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:05:32.666178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Returning 404 to user: Instance 502fdc2f-4dfc-44de-809c-70086990db22 could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:05:32.666178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a9f50b26-a8d7-4f34-bc8a-8a84da8339f2 tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jul 20 22:05:32.666178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 615/1175] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:05:32 2022] GET /compute/v2.1/servers/502fdc2f-4dfc-44de-809c-70086990db22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:05:32.829477 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-26f1b5d4-1aaa-4bf7-9d7e-5660d22c128a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] Calling method '.version_select at 0x7f6abaab7790>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:05:32.852517 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-26f1b5d4-1aaa-4bf7-9d7e-5660d22c128a tempest-TestShelveInstance-2016105005 tempest-TestShelveInstance-2016105005-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-815779289" status: 202 len: 0 microversion: 2.1 time: 0.027311 Jul 20 22:05:32.853159 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 561/1176] 10.222.0.86 () {58 vars in 1250 bytes} [Wed Jul 20 22:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-815779289 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:05:51.410535 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=8 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:51.412105 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=16 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:51.597613 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-57f7565b-b233-4a45-bf39-ad31aa1cbd49 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Action: 'create', calling method: .version_select at 0x7f6aba7ba430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1241537853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6FDY+u/n3ZCj9qlJlJaSuxDMUuu/ln+iRVzFvbowdpoZVo4jjV3pCeUErf9GafUDPXoO2+dBs3/jWPeuluRyAKsZeF+VpFvniVHcEaIfMHXtV85ZfMS1y82mRoBijs9g=="}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:05:51.617596 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-57f7565b-b233-4a45-bf39-ad31aa1cbd49 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for project edb66957f3a041039ae0d6ac39476549. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:05:51.623792 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-57f7565b-b233-4a45-bf39-ad31aa1cbd49 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for user 40553bbbf7af408dbffb8da1beab1062 and project edb66957f3a041039ae0d6ac39476549. Resources: {'key_pairs'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:05:51.654474 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-57f7565b-b233-4a45-bf39-ad31aa1cbd49 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.249069 Jul 20 22:05:51.655092 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 616/1177] 10.222.0.86 () {60 vars in 1158 bytes} [Wed Jul 20 22:05:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:06:08.945917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:08.946751 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:08.951193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989712130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1241537853", "security_groups": [{"name": "tempest-secgroup-smoke-1198746144"}], "block_device_mapping_v2": [{"uuid": "bc49aaf6-ee4c-4469-9e88-188004762f81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f699f657-00dd-4ff4-bf32-5e4f746d5110"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:06:09.067262 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] validate_networks() for [('f699f657-00dd-4ff4-bf32-5e4f746d5110', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:06:09.702259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:06:09.702712 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:06:09.703235 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:06:09.703644 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:06:09.704049 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:06:09.713500 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:09.713937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:09.714717 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:09.715178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:09.731534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:06:09.735413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for user 40553bbbf7af408dbffb8da1beab1062 and project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:06:09.792534 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:06:09.794740 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc49aaf6-ee4c-4469-9e88-188004762f81',volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:06:09.922468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d4ccd208-6a7a-402c-bd68-ca604e712a7c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978599 Jul 20 22:06:09.923136 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 562/1178] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:06:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:06:09.931175 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:09.932204 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:09.936114 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c6e5cd1c-a655-4596-bee9-226a9cb2a608 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:09.936700 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c6e5cd1c-a655-4596-bee9-226a9cb2a608 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:09.992200 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-c6e5cd1c-a655-4596-bee9-226a9cb2a608 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:09.998940 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c6e5cd1c-a655-4596-bee9-226a9cb2a608 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1095 microversion: 2.1 time: 0.069271 Jul 20 22:06:09.999794 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 617/1179] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:09 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:11.017022 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4fa0b12f-7332-4e29-8d19-a7d00965d912 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:11.017643 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4fa0b12f-7332-4e29-8d19-a7d00965d912 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:11.073482 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4fa0b12f-7332-4e29-8d19-a7d00965d912 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:11.080277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4fa0b12f-7332-4e29-8d19-a7d00965d912 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1095 microversion: 2.1 time: 0.067709 Jul 20 22:06:11.080859 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 563/1180] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:11 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:12.097422 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-04018806-0c4a-4127-bf1b-9e3a731971b2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:12.098067 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-04018806-0c4a-4127-bf1b-9e3a731971b2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:12.159097 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-04018806-0c4a-4127-bf1b-9e3a731971b2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:12.171097 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-04018806-0c4a-4127-bf1b-9e3a731971b2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1095 microversion: 2.1 time: 0.077452 Jul 20 22:06:12.171676 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 618/1181] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:12 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:13.188299 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-96624432-fe4d-43fd-8d02-0240e37a7ca5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:13.188896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-96624432-fe4d-43fd-8d02-0240e37a7ca5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:13.255137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-96624432-fe4d-43fd-8d02-0240e37a7ca5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:13.262188 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-96624432-fe4d-43fd-8d02-0240e37a7ca5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1095 microversion: 2.1 time: 0.078048 Jul 20 22:06:13.262799 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 564/1182] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:13 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:14.278093 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:14.278648 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:14.287223 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:14.287678 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:14.288454 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:14.288891 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:14.356933 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:14.364723 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-92d095cf-4fde-41f0-89f7-9b6bbb8d1165 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1145 microversion: 2.1 time: 0.090520 Jul 20 22:06:14.365315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 619/1183] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:14 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:15.382779 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:15.383460 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:15.390684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:15.391236 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:15.391971 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:15.392447 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:15.476943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:15.485498 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-1763709c-955d-4599-b4d4-23d245ee60ef tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1211 microversion: 2.1 time: 0.107473 Jul 20 22:06:15.486093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 565/1184] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:15 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:16.498301 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-187e6f43-e12e-4822-978c-f94a1f1b8b27 req-f731c17d-fc18-4c7c-a42e-1fdefd8581f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc", "tag": "f693da91-2075-4440-acdd-7d7a8f92a8cc"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:06:16.503681 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:16.506711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:16.509741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-187e6f43-e12e-4822-978c-f94a1f1b8b27 req-f731c17d-fc18-4c7c-a42e-1fdefd8581f8 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:16.510199 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-187e6f43-e12e-4822-978c-f94a1f1b8b27 req-f731c17d-fc18-4c7c-a42e-1fdefd8581f8 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:16.518527 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:16.518895 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:16.519943 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:16.520377 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:16.526059 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-187e6f43-e12e-4822-978c-f94a1f1b8b27 req-f731c17d-fc18-4c7c-a42e-1fdefd8581f8 service nova] Creating event network-changed:f693da91-2075-4440-acdd-7d7a8f92a8cc for instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc on hv-cinder-84969 Jul 20 22:06:16.531234 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-187e6f43-e12e-4822-978c-f94a1f1b8b27 req-f731c17d-fc18-4c7c-a42e-1fdefd8581f8 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036540 Jul 20 22:06:16.532173 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 620/1185] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:06:16.773969 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:16.782124 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-81856e67-9ac8-48d9-bd33-1cdb29998983 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.283178 Jul 20 22:06:16.782651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 566/1186] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:16 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:06:17.801793 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:17.802427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:17.809302 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:17.809749 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:17.810514 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:17.810949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:17.946917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:17.954574 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f5ee9271-ede7-4bdb-be1e-3c838ee0aec8 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.158172 Jul 20 22:06:17.955163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 621/1187] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:17 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:06:18.971355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:18.972034 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:18.978898 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:18.979415 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:18.980193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:18.980628 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:19.121645 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:19.130776 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-d0252d72-8fe8-4936-9fae-36755733b9f6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.162046 Jul 20 22:06:19.131402 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 567/1188] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:18 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:20.149320 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:20.149908 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:20.156710 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:20.157154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:20.157920 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:20.158349 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:20.296897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:20.305034 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4395d54d-a675-4269-8eb4-9f28fe33d331 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.159616 Jul 20 22:06:20.305612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 622/1189] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:20 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:21.322000 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:21.322610 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:21.324515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:21.330353 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:21.330809 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:21.331680 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:21.332564 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:21.362639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:06:21.363266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:06:21.471895 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:21.480193 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4ad39a00-c833-4a1a-9425-9d586380e77a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.162060 Jul 20 22:06:21.480774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 568/1190] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:21 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:22.497612 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:22.498230 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:22.500411 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=4 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:22.506140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:22.506592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:22.508897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:22.508897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:22.644426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:22.652815 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-8274b595-7798-4afa-83ec-b7fa6d600c6b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.159178 Jul 20 22:06:22.653423 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 623/1191] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:22 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:23.670228 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:23.670873 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:23.673220 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=10 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:23.680699 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:23.681154 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:23.681928 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:23.682362 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:23.818519 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:23.826608 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-804a478c-18bb-40aa-bb9d-8e1de341b1fb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.160246 Jul 20 22:06:23.827210 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 569/1192] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:23 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:24.843245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:24.843844 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:24.850867 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:24.851348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:24.852126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:24.852561 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:25.001125 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:25.014407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f2039538-a3fe-4fc6-8cf9-a65ffe431781 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.174678 Jul 20 22:06:25.015140 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 624/1193] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:24 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:26.032438 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:26.033057 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:26.039990 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:26.040638 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:26.041433 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:26.041863 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:26.185078 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:26.193296 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-277e8422-a964-421b-b295-c0e955eae25a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.164738 Jul 20 22:06:26.193896 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 570/1194] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:26 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:27.210482 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:27.211455 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:27.217798 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:27.218244 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:27.219005 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:27.219477 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:27.360625 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:27.368633 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e42a7710-d204-4c72-98c4-37bdd7c62021 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.162449 Jul 20 22:06:27.369223 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 625/1195] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:27 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:27.673355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-e6f03219-536e-4e08-87cd-4e64f0288c5c req-1cbf79c0-6b10-48a0-b72a-baafb17d3cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc", "name": "network-vif-plugged", "status": "completed", "tag": "f693da91-2075-4440-acdd-7d7a8f92a8cc"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:06:27.682325 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e6f03219-536e-4e08-87cd-4e64f0288c5c req-1cbf79c0-6b10-48a0-b72a-baafb17d3cd2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:27.682795 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-e6f03219-536e-4e08-87cd-4e64f0288c5c req-1cbf79c0-6b10-48a0-b72a-baafb17d3cd2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:27.696819 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-e6f03219-536e-4e08-87cd-4e64f0288c5c req-1cbf79c0-6b10-48a0-b72a-baafb17d3cd2 service nova] Creating event network-vif-plugged:f693da91-2075-4440-acdd-7d7a8f92a8cc for instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc on hv-cinder-84969 Jul 20 22:06:27.701913 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-e6f03219-536e-4e08-87cd-4e64f0288c5c req-1cbf79c0-6b10-48a0-b72a-baafb17d3cd2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032363 Jul 20 22:06:27.702514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 571/1196] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:06:28.386724 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:28.387396 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:28.393932 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:28.394381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:28.395172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:28.395608 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:28.531979 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:28.540537 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ebfbad25-6965-47e4-a0f5-9d798e71de62 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1267 microversion: 2.1 time: 0.157803 Jul 20 22:06:28.541111 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 626/1197] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:28 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:29.558995 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:29.559812 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:29.566793 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:29.567314 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:29.568084 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:29.568522 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:29.711153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:29.718848 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-a3b91d09-ab17-42f9-a39e-365485ad46d1 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1453 microversion: 2.1 time: 0.164626 Jul 20 22:06:29.719465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 572/1198] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:29 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:06:29.735515 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:06:29.736151 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:06:29.743506 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:29.743954 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:29.744714 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:29.745147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:29.882534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:06:29.890472 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-468e3697-fd19-4ed4-93a6-fa176ccf3bcd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1453 microversion: 2.1 time: 0.158966 Jul 20 22:06:29.891077 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 627/1199] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:06:29 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:06:31.966321 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-14dbaa93-ab67-43ea-82c2-c9848fa44f70 req-a908cf11-530a-40b2-acbc-8eaa9ffb3407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc", "tag": "f693da91-2075-4440-acdd-7d7a8f92a8cc"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:06:31.976413 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-14dbaa93-ab67-43ea-82c2-c9848fa44f70 req-a908cf11-530a-40b2-acbc-8eaa9ffb3407 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:06:31.976958 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-14dbaa93-ab67-43ea-82c2-c9848fa44f70 req-a908cf11-530a-40b2-acbc-8eaa9ffb3407 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:06:31.990728 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-14dbaa93-ab67-43ea-82c2-c9848fa44f70 req-a908cf11-530a-40b2-acbc-8eaa9ffb3407 service nova] Creating event network-changed:f693da91-2075-4440-acdd-7d7a8f92a8cc for instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc on hv-cinder-84969 Jul 20 22:06:31.994788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-14dbaa93-ab67-43ea-82c2-c9848fa44f70 req-a908cf11-530a-40b2-acbc-8eaa9ffb3407 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032037 Jul 20 22:06:31.995783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 573/1200] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:07:47.659505 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:07:47.660355 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:08:21.973446 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:08:21.974085 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:08:29.714693 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [645c88ac-f3f6-4f3f-aee8-cc35a64b3c88] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 22:08:29.715624 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=26 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:29.716505 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=50 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:29.721757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:29.722256 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:29.729589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:29.729589 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:29.730084 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:29.730516 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:29.761513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:08:29.844558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b22c4066-63c9-4145-853b-981f8c598799 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 204 len: 0 microversion: 2.1 time: 0.131795 Jul 20 22:08:29.845148 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 628/1201] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:08:29 2022] DELETE /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:08:29.851852 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd86d24f-29d8-4b1b-8ad1-69a113b87d60] AMQP server on 10.222.0.86:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 22:08:29.852489 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:29.853215 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=48 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:29.857847 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:29.858526 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:29.867495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:29.867940 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:29.868708 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:29.869137 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:30.075582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:30.083983 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-dee1d1a0-3363-44c1-ae82-1dd04840ef31 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1577 microversion: 2.1 time: 0.233920 Jul 20 22:08:30.084570 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 574/1202] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:29 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:08:31.110759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:31.111490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:31.123082 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:31.123533 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:31.124995 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:31.125426 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:31.146342 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] [645c88ac-f3f6-4f3f-aee8-cc35a64b3c88] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 35968. Jul 20 22:08:31.323558 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:31.331665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-90a9d7ca-0b17-4c1a-ad40-f6f42ab43adf tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1577 microversion: 2.1 time: 0.225019 Jul 20 22:08:31.332242 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 629/1203] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:31 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:32.349738 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:32.350567 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:32.359127 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:32.359660 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:32.360528 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:32.361051 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:32.368506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd86d24f-29d8-4b1b-8ad1-69a113b87d60] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 35974. Jul 20 22:08:32.372752 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-c8163699-22df-4ead-afdd-6cc9c9fa2337 req-363dfa42-4b18-4f81-8082-8d3c256dc6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc", "name": "network-vif-deleted", "tag": "f693da91-2075-4440-acdd-7d7a8f92a8cc"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:08:32.382747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c8163699-22df-4ead-afdd-6cc9c9fa2337 req-363dfa42-4b18-4f81-8082-8d3c256dc6b2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:32.383333 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-c8163699-22df-4ead-afdd-6cc9c9fa2337 req-363dfa42-4b18-4f81-8082-8d3c256dc6b2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:32.397149 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-c8163699-22df-4ead-afdd-6cc9c9fa2337 req-363dfa42-4b18-4f81-8082-8d3c256dc6b2 service nova] Creating event network-vif-deleted:f693da91-2075-4440-acdd-7d7a8f92a8cc for instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc on hv-cinder-84969 Jul 20 22:08:32.408216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-c8163699-22df-4ead-afdd-6cc9c9fa2337 req-363dfa42-4b18-4f81-8082-8d3c256dc6b2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038465 Jul 20 22:08:32.419338 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 630/1204] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:08:32.455178 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:32.465711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-91282e2e-c74b-4038-b2c4-0dde24e11cf7 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 200 len: 1509 microversion: 2.1 time: 0.119958 Jul 20 22:08:32.466714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 575/1205] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:32 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 1509 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:33.485519 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:33.486216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:33.492628 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:33.493073 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:33.493843 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:33.494277 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:33.509892 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] HTTP exception thrown: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Request method failure captured: Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc HTTP/1.1 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hw5W2EZIyWaIbwfWAbxvRjMMaWglfNik3Y4WHKhsYOfMS4YZlLpBvK3pd7KWlTFcjtubXqxzLIJG6bvGRG1bbJ6qcc2oUsi-zA34kHhyjRZw6beXNav8TVaeqfoTiT0VeOEujekbWzso4yKByQIdakDA7YELp1VFzfjJbXhGFb_fFo Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:08:33.511611 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_edb66957f3a041039ae0d6ac39476549", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}] Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 40553bbbf7af408dbffb8da1beab1062 Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:08:33.513178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc'} Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:08:33.514393 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:08:33.517021 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:08:33.519376 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Returning 404 to user: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:08:33.520251 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-92a1b407-ab2a-443d-b421-04ede53d0d8c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 404 len: 111 microversion: 2.1 time: 0.041390 Jul 20 22:08:33.520824 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 631/1206] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:33 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:08:33.576305 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1157511124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1241537853", "security_groups": [{"name": "tempest-secgroup-smoke-1198746144"}], "block_device_mapping_v2": [{"uuid": "bc49aaf6-ee4c-4469-9e88-188004762f81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f699f657-00dd-4ff4-bf32-5e4f746d5110"}]}} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:08:33.695412 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.network.neutron [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] validate_networks() for [('f699f657-00dd-4ff4-bf32-5e4f746d5110', None, None, None, None, None)] {{(pid=124150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:08:34.091045 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:08:34.091491 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image limits 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:08:34.091962 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:08:34.092366 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image pref 0:0:0 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:08:34.092774 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.virt.hardware [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:08:34.101763 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:34.102207 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:34.102993 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:34.103462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:34.123437 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:08:34.128946 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.quota [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for user 40553bbbf7af408dbffb8da1beab1062 and project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:08:34.188615 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Going to run 1 instances... {{(pid=124150) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:08:34.190707 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc49aaf6-ee4c-4469-9e88-188004762f81',volume_size=None,volume_type=None)] {{(pid=124150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:08:34.323486 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ff2b843e-dff3-450d-bad3-388baa0c423f tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750788 Jul 20 22:08:34.324145 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 576/1207] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:08:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 22:08:34.334712 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-2ebb4b8f-2178-4fdf-92ee-1efebdef1e6c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:34.335262 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-2ebb4b8f-2178-4fdf-92ee-1efebdef1e6c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:34.395384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-2ebb4b8f-2178-4fdf-92ee-1efebdef1e6c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:34.401977 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-2ebb4b8f-2178-4fdf-92ee-1efebdef1e6c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1095 microversion: 2.1 time: 0.071196 Jul 20 22:08:34.402703 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 632/1208] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:34 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:35.418942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:35.419705 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:35.428756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:35.430668 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:35.431685 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:35.432135 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:35.531605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:35.539697 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-7707d690-787b-4cac-8f99-0a9d496fe24c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1211 microversion: 2.1 time: 0.124551 Jul 20 22:08:35.540289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 577/1209] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:35 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:36.565890 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:36.567384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:36.577404 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:36.578992 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:36.580001 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:36.580756 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:36.800110 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:36.808119 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d6dedea1-e125-4d18-b0cd-7b31531a46d6 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.248049 Jul 20 22:08:36.808716 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 633/1210] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:36 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:36.879192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-c69c9674-0d53-4ce6-b9f9-e6500de00028 req-f01c2453-ff42-4bb7-b2b5-d05c189f3fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5e28e-b134-4485-ba56-409ae4258b63", "tag": "303dd2e2-21b3-453b-a2b1-dc1719277da1"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:08:36.893631 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c69c9674-0d53-4ce6-b9f9-e6500de00028 req-f01c2453-ff42-4bb7-b2b5-d05c189f3fa5 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:36.894131 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c69c9674-0d53-4ce6-b9f9-e6500de00028 req-f01c2453-ff42-4bb7-b2b5-d05c189f3fa5 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:36.906960 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-c69c9674-0d53-4ce6-b9f9-e6500de00028 req-f01c2453-ff42-4bb7-b2b5-d05c189f3fa5 service nova] Creating event network-changed:303dd2e2-21b3-453b-a2b1-dc1719277da1 for instance 28c5e28e-b134-4485-ba56-409ae4258b63 on hv-cinder-84969 Jul 20 22:08:36.915783 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-c69c9674-0d53-4ce6-b9f9-e6500de00028 req-f01c2453-ff42-4bb7-b2b5-d05c189f3fa5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040157 Jul 20 22:08:36.916824 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 578/1211] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:08:37.826851 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:37.827719 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:37.834856 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:37.836388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:37.836388 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:37.836643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:38.056399 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:38.064929 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-44861caf-30ce-4817-a1ee-570c71e1a72c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.242216 Jul 20 22:08:38.065598 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 634/1212] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:37 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:39.083506 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:39.084213 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:39.090676 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:39.091157 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:39.091936 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:39.092371 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:39.235562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:39.243175 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ef8e1f77-6d1a-48ce-ad8f-93f843bc2cdd tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.164428 Jul 20 22:08:39.243755 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 579/1213] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:39 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:40.260840 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:40.261453 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:40.268304 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:40.268759 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:40.269543 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:40.269982 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:40.701608 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:40.709443 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a96e5892-837e-4bac-9d13-fa6c1a28ea44 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.452463 Jul 20 22:08:40.710014 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 635/1214] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:40 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:41.725788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:41.726390 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:41.733043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:41.733992 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:41.734758 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:41.735227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:41.868482 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:41.876980 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-81ed0c93-2f34-49cb-872a-073b06a16f88 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.155002 Jul 20 22:08:41.877557 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 580/1215] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:41 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:42.894452 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:42.895051 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:42.901780 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:42.902179 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:42.902950 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:42.903416 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:43.043810 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:43.051522 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4c453456-1882-4df6-bc02-717e7c1f6bed tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.161479 Jul 20 22:08:43.052107 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 636/1216] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:42 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:44.071924 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:44.073182 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:44.081521 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:44.081970 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:44.082739 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:44.083346 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:44.114316 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=2 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:44.137245 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=6 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:44.220376 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:44.227995 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-dc8f2fa6-8368-4f42-bdea-4c2a9c64070c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.163119 Jul 20 22:08:44.228591 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 581/1217] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:44 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:45.244790 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:45.245420 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:45.247834 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:45.253989 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:45.254430 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:45.255245 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:45.255670 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:45.418280 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:45.426981 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ce70d625-f1e2-4a83-a222-6d61638ca21e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.186075 Jul 20 22:08:45.427581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 637/1218] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:45 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:46.444715 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:46.445348 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:46.453562 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:46.454043 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:46.455038 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:46.455515 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:46.473501 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-3eaf7fae-8863-4301-be94-68ee097ea7f8 req-448305f2-de3d-4b5d-bb51-126ab9ea8cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c5e28e-b134-4485-ba56-409ae4258b63", "name": "network-vif-plugged", "status": "completed", "tag": "303dd2e2-21b3-453b-a2b1-dc1719277da1"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:08:46.483023 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-3eaf7fae-8863-4301-be94-68ee097ea7f8 req-448305f2-de3d-4b5d-bb51-126ab9ea8cba service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:46.483786 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-3eaf7fae-8863-4301-be94-68ee097ea7f8 req-448305f2-de3d-4b5d-bb51-126ab9ea8cba service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:46.499307 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-3eaf7fae-8863-4301-be94-68ee097ea7f8 req-448305f2-de3d-4b5d-bb51-126ab9ea8cba service nova] Creating event network-vif-plugged:303dd2e2-21b3-453b-a2b1-dc1719277da1 for instance 28c5e28e-b134-4485-ba56-409ae4258b63 on hv-cinder-84969 Jul 20 22:08:46.506216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-3eaf7fae-8863-4301-be94-68ee097ea7f8 req-448305f2-de3d-4b5d-bb51-126ab9ea8cba service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036029 Jul 20 22:08:46.506216 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 638/1219] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:08:46.623363 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:46.631600 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-9d8739b5-4706-436b-bf0e-9a6b817d1e3a tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.191408 Jul 20 22:08:46.632192 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 582/1220] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:46 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:47.649763 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:47.650464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:47.657466 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:47.657916 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:47.658691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:47.659154 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:47.804782 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:47.813471 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-efa46559-8c9a-464d-8a20-5892e787a970 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1267 microversion: 2.1 time: 0.168361 Jul 20 22:08:47.814064 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 639/1221] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:47 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:48.830256 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:48.830872 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:48.837476 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:48.837926 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:48.838698 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:48.839153 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:48.975149 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:48.982808 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-b83a4d56-9e6e-4939-8bb0-98232caa65ce tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1453 microversion: 2.1 time: 0.157146 Jul 20 22:08:48.983468 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 583/1222] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:48 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:08:49.000819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:08:49.001429 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:08:49.008172 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:49.008618 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:49.009382 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:49.009815 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:49.146345 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:08:49.154142 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ed96709c-f8b3-47dd-84f6-221901711078 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1453 microversion: 2.1 time: 0.157880 Jul 20 22:08:49.154727 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 640/1223] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:08:48 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:08:50.814904 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-18f04760-2188-4ade-a03b-dcb5cb09aff4 req-54c5694c-bfe7-487a-8d54-445878f4d17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5e28e-b134-4485-ba56-409ae4258b63", "tag": "303dd2e2-21b3-453b-a2b1-dc1719277da1"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:08:50.824239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-18f04760-2188-4ade-a03b-dcb5cb09aff4 req-54c5694c-bfe7-487a-8d54-445878f4d17a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:08:50.824826 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-18f04760-2188-4ade-a03b-dcb5cb09aff4 req-54c5694c-bfe7-487a-8d54-445878f4d17a service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:08:50.838999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-18f04760-2188-4ade-a03b-dcb5cb09aff4 req-54c5694c-bfe7-487a-8d54-445878f4d17a service nova] Creating event network-changed:303dd2e2-21b3-453b-a2b1-dc1719277da1 for instance 28c5e28e-b134-4485-ba56-409ae4258b63 on hv-cinder-84969 Jul 20 22:08:50.844596 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-18f04760-2188-4ade-a03b-dcb5cb09aff4 req-54c5694c-bfe7-487a-8d54-445878f4d17a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034975 Jul 20 22:08:50.845494 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 584/1224] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:09:41.371518 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:09:41.372132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:10:27.428088 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:27.428855 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:27.433585 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1091414726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1241537853", "security_groups": [{"name": "tempest-secgroup-smoke-1198746144"}], "block_device_mapping_v2": [{"uuid": "cdce15bb-3bb9-46fd-97cb-5253352fdc98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f699f657-00dd-4ff4-bf32-5e4f746d5110"}]}} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:10:27.555588 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.network.neutron [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] validate_networks() for [('f699f657-00dd-4ff4-bf32-5e4f746d5110', None, None, None, None, None)] {{(pid=124151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:10:28.007833 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:10:28.008262 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image limits 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:10:28.008757 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Flavor pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:10:28.009163 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Image pref 0:0:0 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:10:28.009578 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.virt.hardware [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:10:28.020594 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:28.021047 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:28.021849 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:28.022284 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:28.040311 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:10:28.045097 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.quota [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Getting quotas for user 40553bbbf7af408dbffb8da1beab1062 and project edb66957f3a041039ae0d6ac39476549. Resources: {'instances', 'cores', 'ram'} {{(pid=124151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:10:28.103274 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Going to run 1 instances... {{(pid=124151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:10:28.105407 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdce15bb-3bb9-46fd-97cb-5253352fdc98',volume_size=None,volume_type=None)] {{(pid=124151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:10:28.240250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-00bdab6e-4c96-47cf-a536-34ce6d92cb3d tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813828 Jul 20 22:10:28.240907 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 641/1225] 10.222.0.86 () {60 vars in 1146 bytes} [Wed Jul 20 22:10:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:10:28.250289 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:28.251714 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=54 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:28.256927 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-f71813fb-87de-4bb3-9163-f244be652f94 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:28.257420 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-f71813fb-87de-4bb3-9163-f244be652f94 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:28.317503 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-f71813fb-87de-4bb3-9163-f244be652f94 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:28.325406 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-f71813fb-87de-4bb3-9163-f244be652f94 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1095 microversion: 2.1 time: 0.077301 Jul 20 22:10:28.325995 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 585/1226] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:28 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:29.349779 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-36d03ad2-aebf-471a-99b9-7c495e37c238 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:29.350394 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-36d03ad2-aebf-471a-99b9-7c495e37c238 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:29.407829 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-36d03ad2-aebf-471a-99b9-7c495e37c238 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:29.414476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-36d03ad2-aebf-471a-99b9-7c495e37c238 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1095 microversion: 2.1 time: 0.068562 Jul 20 22:10:29.415042 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 642/1227] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:29 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:30.431988 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-8c72a3f2-0e46-42dd-88ff-bee76d598444 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:30.432601 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-8c72a3f2-0e46-42dd-88ff-bee76d598444 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:30.486986 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-8c72a3f2-0e46-42dd-88ff-bee76d598444 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:30.494464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-8c72a3f2-0e46-42dd-88ff-bee76d598444 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1095 microversion: 2.1 time: 0.066793 Jul 20 22:10:30.495027 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 586/1228] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:30 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:31.513249 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-4dd40657-cbef-4a4b-b859-52efd6734463 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:31.513949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-4dd40657-cbef-4a4b-b859-52efd6734463 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:31.568534 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-4dd40657-cbef-4a4b-b859-52efd6734463 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:31.575592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-4dd40657-cbef-4a4b-b859-52efd6734463 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1095 microversion: 2.1 time: 0.066787 Jul 20 22:10:31.576174 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 643/1229] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:31 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:32.594380 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:32.594975 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:32.601239 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:32.601686 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:32.602432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:32.602861 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:32.662895 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:32.671427 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c0fae5b5-eb1b-421b-81aa-4ccde8912df5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1145 microversion: 2.1 time: 0.081654 Jul 20 22:10:32.671999 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 587/1230] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:32 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:33.690681 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:33.691315 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:33.698581 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:33.698996 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:33.700310 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:33.701595 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:33.791935 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:33.800218 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-f8514de6-3eb8-4e53-94c0-7c33a188cf72 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1211 microversion: 2.1 time: 0.115868 Jul 20 22:10:33.800803 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 644/1231] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:33 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:34.817935 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:34.819286 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:34.826854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:34.827337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:34.828339 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:34.828801 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:35.093731 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:35.102694 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-cbbd83b3-86bd-4de6-86c9-479e761d416c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.288603 Jul 20 22:10:35.103595 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 588/1232] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:34 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:35.104697 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [req-e55b4e36-1e70-4b56-b5a1-58b2741c06b0 req-da3c74fe-b080-4a18-9d56-451d3119eecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86dede60-2a50-486a-bfd8-9daf5773f1ba", "tag": "3e3517ea-f64d-4d89-b72e-4adcff9c7ec4"}]} {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:10:35.118177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-e55b4e36-1e70-4b56-b5a1-58b2741c06b0 req-da3c74fe-b080-4a18-9d56-451d3119eecc service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:35.118615 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [req-e55b4e36-1e70-4b56-b5a1-58b2741c06b0 req-da3c74fe-b080-4a18-9d56-451d3119eecc service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:35.134072 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.compute.server_external_events [req-e55b4e36-1e70-4b56-b5a1-58b2741c06b0 req-da3c74fe-b080-4a18-9d56-451d3119eecc service nova] Creating event network-changed:3e3517ea-f64d-4d89-b72e-4adcff9c7ec4 for instance 86dede60-2a50-486a-bfd8-9daf5773f1ba on hv-cinder-84969 Jul 20 22:10:35.139999 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [req-e55b4e36-1e70-4b56-b5a1-58b2741c06b0 req-da3c74fe-b080-4a18-9d56-451d3119eecc service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134813 Jul 20 22:10:35.140599 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 645/1233] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:10:36.120817 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:36.121464 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:36.128815 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:36.129273 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:36.130061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:36.130501 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:36.334416 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:36.342679 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-3600420a-e8d2-42da-bac3-4412d8bdfcbb tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.226043 Jul 20 22:10:36.343295 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 589/1234] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:36 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:37.361367 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:37.362070 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:37.368476 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:37.368906 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:37.369680 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:37.370144 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:37.515369 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:37.523572 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-37b93f4e-be6c-49c0-94ba-6f44eec712cc tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.167520 Jul 20 22:10:37.524178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 646/1235] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:37 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:38.541574 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:38.542224 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:38.550216 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:38.550677 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:38.551543 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:38.551984 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:38.690741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:38.698609 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-da677e23-0267-4473-a67b-3fdf2c09127e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.160863 Jul 20 22:10:38.699219 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 590/1236] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:38 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:39.716458 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:39.717089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:39.719224 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=2 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:39.725228 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:39.725684 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:39.726465 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:39.726902 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:39.871232 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:39.879165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ca248582-272d-4925-89c5-3b8d86ebb275 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.166803 Jul 20 22:10:39.879741 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 647/1237] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:39 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:40.896181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:40.896787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:40.899073 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell0:SELECT=4 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:40.905277 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:40.905723 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:40.906488 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:40.906917 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:41.044846 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:41.052672 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-846a61b0-4074-442d-8951-863f95867cca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.160319 Jul 20 22:10:41.053253 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 591/1238] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:40 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:42.069901 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:42.070510 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:42.073972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell0:SELECT=10 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:42.078143 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:42.078592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:42.079385 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:42.079819 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:42.213451 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:42.221922 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-be52bcab-67ab-4278-9011-296d7aaa0c03 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.156445 Jul 20 22:10:42.222490 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 648/1239] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:42 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:43.239093 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:43.239711 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:43.246337 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:43.247454 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:43.248223 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:43.248664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:43.383749 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:43.392790 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ef4cbb4d-f710-4a5b-8b97-404806d44bf2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.157579 Jul 20 22:10:43.393465 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 592/1240] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:43 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:44.411852 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:44.412495 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:44.419296 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:44.419744 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:44.420493 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:44.420967 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:44.557688 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:44.565178 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-18a2ed42-e799-4587-8d6d-4255b44a38ee tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.157474 Jul 20 22:10:44.565747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 649/1241] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:44 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:45.236788 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-ae64bec6-d6a4-4e0b-8c95-15eadf84b920 req-13dddc83-a754-47bd-adbd-b602179021a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86dede60-2a50-486a-bfd8-9daf5773f1ba", "name": "network-vif-plugged", "status": "completed", "tag": "3e3517ea-f64d-4d89-b72e-4adcff9c7ec4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:10:45.244854 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ae64bec6-d6a4-4e0b-8c95-15eadf84b920 req-13dddc83-a754-47bd-adbd-b602179021a2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:45.245317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-ae64bec6-d6a4-4e0b-8c95-15eadf84b920 req-13dddc83-a754-47bd-adbd-b602179021a2 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:45.256657 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-ae64bec6-d6a4-4e0b-8c95-15eadf84b920 req-13dddc83-a754-47bd-adbd-b602179021a2 service nova] Creating event network-vif-plugged:3e3517ea-f64d-4d89-b72e-4adcff9c7ec4 for instance 86dede60-2a50-486a-bfd8-9daf5773f1ba on hv-cinder-84969 Jul 20 22:10:45.261860 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-ae64bec6-d6a4-4e0b-8c95-15eadf84b920 req-13dddc83-a754-47bd-adbd-b602179021a2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149362 Jul 20 22:10:45.262511 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 593/1242] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:10:45.582071 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:45.582691 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:45.589168 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:45.589621 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:45.591147 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:45.591592 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:45.722686 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:45.730150 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e7a1fbc8-7409-4285-87f8-f31e12206ed5 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1267 microversion: 2.1 time: 0.151878 Jul 20 22:10:45.730701 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 650/1243] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:45 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:46.747377 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:46.748066 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:46.754976 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:46.755453 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:46.756203 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:46.756634 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:46.892480 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:46.900020 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-4d641227-99f4-433e-af98-8a6aa314baa3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1454 microversion: 2.1 time: 0.156994 Jul 20 22:10:46.900586 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 594/1244] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:46 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:46.916130 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:10:46.916742 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:10:46.923903 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:46.924355 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:46.925115 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:46.925549 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:47.059266 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:10:47.066897 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-5202b942-a753-422e-8e44-772e1904c605 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1454 microversion: 2.1 time: 0.154556 Jul 20 22:10:47.067521 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 651/1245] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:10:46 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:10:48.665011 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-c9f0ddef-a9d3-4016-a6f5-e5d60532a65e req-4ca39c7a-708f-43b7-bce2-a07cae49ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86dede60-2a50-486a-bfd8-9daf5773f1ba", "tag": "3e3517ea-f64d-4d89-b72e-4adcff9c7ec4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:10:48.674220 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c9f0ddef-a9d3-4016-a6f5-e5d60532a65e req-4ca39c7a-708f-43b7-bce2-a07cae49ae6b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:10:48.674664 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c9f0ddef-a9d3-4016-a6f5-e5d60532a65e req-4ca39c7a-708f-43b7-bce2-a07cae49ae6b service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:10:48.686617 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-c9f0ddef-a9d3-4016-a6f5-e5d60532a65e req-4ca39c7a-708f-43b7-bce2-a07cae49ae6b service nova] Creating event network-changed:3e3517ea-f64d-4d89-b72e-4adcff9c7ec4 for instance 86dede60-2a50-486a-bfd8-9daf5773f1ba on hv-cinder-84969 Jul 20 22:10:48.692077 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-c9f0ddef-a9d3-4016-a6f5-e5d60532a65e req-4ca39c7a-708f-43b7-bce2-a07cae49ae6b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030797 Jul 20 22:10:48.692982 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 595/1246] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:11:07.668053 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:11:07.668756 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:11:19.968141 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:11:19.968882 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:11:22.276247 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:11:22.276770 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:12:25.463250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:25.464921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG dbcounter [-] [124151] Writing DB stats nova_cell1:SELECT=46 {{(pid=124151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:25.469205 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:25.469379 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_api:SELECT=26 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:25.469807 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:25.470055 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG dbcounter [-] [124150] Writing DB stats nova_cell1:SELECT=46 {{(pid=124150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:25.489638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:25.490089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:25.490865 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:25.491327 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:25.518353 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:12:25.559200 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-cfcf4c06-9033-4ba3-b49a-8a6558321399 req-2c380a52-8d96-4dcc-a2f1-efff1872662d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86dede60-2a50-486a-bfd8-9daf5773f1ba", "tag": "3e3517ea-f64d-4d89-b72e-4adcff9c7ec4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:12:25.567907 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-cfcf4c06-9033-4ba3-b49a-8a6558321399 req-2c380a52-8d96-4dcc-a2f1-efff1872662d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:25.568462 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-cfcf4c06-9033-4ba3-b49a-8a6558321399 req-2c380a52-8d96-4dcc-a2f1-efff1872662d service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:25.581583 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-cfcf4c06-9033-4ba3-b49a-8a6558321399 req-2c380a52-8d96-4dcc-a2f1-efff1872662d service nova] Creating event network-changed:3e3517ea-f64d-4d89-b72e-4adcff9c7ec4 for instance 86dede60-2a50-486a-bfd8-9daf5773f1ba on hv-cinder-84969 Jul 20 22:12:25.587582 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-cfcf4c06-9033-4ba3-b49a-8a6558321399 req-2c380a52-8d96-4dcc-a2f1-efff1872662d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120192 Jul 20 22:12:25.588259 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 596/1247] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:12:25.601513 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-cf6dc180-e6cd-438d-9539-2bcb3a49949b tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "DELETE /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 204 len: 0 microversion: 2.1 time: 0.139967 Jul 20 22:12:25.602286 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 652/1248] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:12:25 2022] DELETE /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:12:25.611524 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:25.612996 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:25.621039 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:25.621606 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:25.622495 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:25.622929 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:25.764977 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:25.772632 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-19362bff-7816-44e7-b24f-a1e3b51eeae4 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1579 microversion: 2.1 time: 0.165598 Jul 20 22:12:25.773198 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 597/1249] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:25 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:12:26.792949 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:26.793552 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:26.800297 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:26.800744 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:26.801497 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:26.801923 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:27.013381 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:27.020888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-b422086a-8c02-4eb2-b4fe-4fc448c5f4ab tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1579 microversion: 2.1 time: 0.232953 Jul 20 22:12:27.021485 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 653/1250] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:26 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1579 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:12:27.819942 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-c5ad12b0-3e6b-4fd0-9aeb-330a0f1fed06 req-db4f4a03-9abc-4cd1-9ec4-ef5ee7e28ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86dede60-2a50-486a-bfd8-9daf5773f1ba", "name": "network-vif-deleted", "tag": "3e3517ea-f64d-4d89-b72e-4adcff9c7ec4"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:12:27.829787 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c5ad12b0-3e6b-4fd0-9aeb-330a0f1fed06 req-db4f4a03-9abc-4cd1-9ec4-ef5ee7e28ed3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:27.830274 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-c5ad12b0-3e6b-4fd0-9aeb-330a0f1fed06 req-db4f4a03-9abc-4cd1-9ec4-ef5ee7e28ed3 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:27.841825 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-c5ad12b0-3e6b-4fd0-9aeb-330a0f1fed06 req-db4f4a03-9abc-4cd1-9ec4-ef5ee7e28ed3 service nova] Creating event network-vif-deleted:3e3517ea-f64d-4d89-b72e-4adcff9c7ec4 for instance 86dede60-2a50-486a-bfd8-9daf5773f1ba on hv-cinder-84969 Jul 20 22:12:27.846718 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-c5ad12b0-3e6b-4fd0-9aeb-330a0f1fed06 req-db4f4a03-9abc-4cd1-9ec4-ef5ee7e28ed3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030464 Jul 20 22:12:27.847402 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 598/1251] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:12:28.037797 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:28.038348 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:28.045425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:28.045880 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:28.046643 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:28.047104 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:28.116089 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:28.124972 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-ee9885f0-fb5a-4c46-bb2e-dd68f00d3025 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 200 len: 1226 microversion: 2.1 time: 0.091038 Jul 20 22:12:28.131124 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 654/1252] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:28 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:12:29.143345 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:29.144044 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 86dede60-2a50-486a-bfd8-9daf5773f1ba] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:29.150287 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:29.150741 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:29.151645 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:29.152088 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:29.165061 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] HTTP exception thrown: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Request method failure captured: Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba HTTP/1.1 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hw5W2EZIyWaIbwfWAbxvRjMMaWglfNik3Y4WHKhsYOfMS4YZlLpBvK3pd7KWlTFcjtubXqxzLIJG6bvGRG1bbJ6qcc2oUsi-zA34kHhyjRZw6beXNav8TVaeqfoTiT0VeOEujekbWzso4yKByQIdakDA7YELp1VFzfjJbXhGFb_fFo Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:12:29.166651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_edb66957f3a041039ae0d6ac39476549", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}] Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 40553bbbf7af408dbffb8da1beab1062 Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. Jul 20 22:12:29.168440 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '86dede60-2a50-486a-bfd8-9daf5773f1ba'} Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:12:29.169304 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. Jul 20 22:12:29.170903 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:29.172561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Returning 404 to user: Instance 86dede60-2a50-486a-bfd8-9daf5773f1ba could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:12:29.172561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-99c52689-f1a8-4322-8ddc-a0121ef18f53 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba" status: 404 len: 111 microversion: 2.1 time: 0.029565 Jul 20 22:12:29.172561 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 599/1253] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:29 2022] GET /compute/v2.1/servers/86dede60-2a50-486a-bfd8-9daf5773f1ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:32.232526 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:32.233048 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:32.239937 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-a5d857f4-215e-4a21-aef9-c9d56215a014 req-b51c5ed9-1e4e-4444-b85f-4279caa84307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5e28e-b134-4485-ba56-409ae4258b63", "tag": "303dd2e2-21b3-453b-a2b1-dc1719277da1"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:12:32.248867 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a5d857f4-215e-4a21-aef9-c9d56215a014 req-b51c5ed9-1e4e-4444-b85f-4279caa84307 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:32.249196 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:32.249340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-a5d857f4-215e-4a21-aef9-c9d56215a014 req-b51c5ed9-1e4e-4444-b85f-4279caa84307 service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:32.249651 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:32.250427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:32.251146 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:32.261514 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-a5d857f4-215e-4a21-aef9-c9d56215a014 req-b51c5ed9-1e4e-4444-b85f-4279caa84307 service nova] Creating event network-changed:303dd2e2-21b3-453b-a2b1-dc1719277da1 for instance 28c5e28e-b134-4485-ba56-409ae4258b63 on hv-cinder-84969 Jul 20 22:12:32.266587 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-a5d857f4-215e-4a21-aef9-c9d56215a014 req-b51c5ed9-1e4e-4444-b85f-4279caa84307 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030230 Jul 20 22:12:32.267393 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 600/1254] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:12:32.280731 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Going to try to terminate instance {{(pid=124151) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:12:32.362745 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-c3a0d0f5-5925-4340-b5a8-b5df340a5fc3 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "DELETE /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 204 len: 0 microversion: 2.1 time: 0.134555 Jul 20 22:12:32.363126 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 655/1255] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:12:32 2022] DELETE /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:12:32.372392 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:32.373403 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:32.380605 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:32.381340 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:32.382317 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:32.382940 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:32.548710 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.policy [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124150) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:32.556297 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-82fa1076-f5b2-4b24-ab43-e374f9a798d2 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1578 microversion: 2.1 time: 0.188678 Jul 20 22:12:32.556876 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 601/1256] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:32 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:12:33.575113 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:33.575816 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:33.582418 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:33.582870 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:33.583665 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:33.584099 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:33.714212 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:33.723036 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-e0edd138-2a29-4dd5-9b3e-54fcb77cca9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1578 microversion: 2.1 time: 0.152874 Jul 20 22:12:33.724191 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 656/1257] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:33 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:12:34.497675 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [req-8e371874-58f2-456e-bd66-b17ac54bd548 req-02840baa-d7a8-4f03-9a93-3cc039e9c24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c5e28e-b134-4485-ba56-409ae4258b63", "name": "network-vif-deleted", "tag": "303dd2e2-21b3-453b-a2b1-dc1719277da1"}]} {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:12:34.507336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-8e371874-58f2-456e-bd66-b17ac54bd548 req-02840baa-d7a8-4f03-9a93-3cc039e9c24f service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:34.507864 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [req-8e371874-58f2-456e-bd66-b17ac54bd548 req-02840baa-d7a8-4f03-9a93-3cc039e9c24f service nova] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:34.520123 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.compute.server_external_events [req-8e371874-58f2-456e-bd66-b17ac54bd548 req-02840baa-d7a8-4f03-9a93-3cc039e9c24f service nova] Creating event network-vif-deleted:303dd2e2-21b3-453b-a2b1-dc1719277da1 for instance 28c5e28e-b134-4485-ba56-409ae4258b63 on hv-cinder-84969 Jul 20 22:12:34.525541 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [req-8e371874-58f2-456e-bd66-b17ac54bd548 req-02840baa-d7a8-4f03-9a93-3cc039e9c24f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Jul 20 22:12:34.526231 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 602/1258] 10.222.0.86 () {64 vars in 1317 bytes} [Wed Jul 20 22:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:12:34.740642 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:34.741250 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:34.748464 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:34.748917 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:34.749747 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:34.750177 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:34.823921 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.policy [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40553bbbf7af408dbffb8da1beab1062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb66957f3a041039ae0d6ac39476549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124151) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:12:34.831601 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-a4d22f6b-3f48-4cb8-8cca-dc51be077862 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 200 len: 1226 microversion: 2.1 time: 0.094959 Jul 20 22:12:34.836765 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 657/1259] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:34 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:12:35.848684 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:35.849404 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: 28c5e28e-b134-4485-ba56-409ae4258b63] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:35.855651 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:35.856094 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:35.856842 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:35.857270 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:35.870833 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] HTTP exception thrown: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Request method failure captured: Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 HTTP/1.1 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hw5W2EZIyWaIbwfWAbxvRjMMaWglfNik3Y4WHKhsYOfMS4YZlLpBvK3pd7KWlTFcjtubXqxzLIJG6bvGRG1bbJ6qcc2oUsi-zA34kHhyjRZw6beXNav8TVaeqfoTiT0VeOEujekbWzso4yKByQIdakDA7YELp1VFzfjJbXhGFb_fFo Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:12:35.872432 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_edb66957f3a041039ae0d6ac39476549", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}] Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 40553bbbf7af408dbffb8da1beab1062 Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. Jul 20 22:12:35.874108 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': '28c5e28e-b134-4485-ba56-409ae4258b63'} Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:12:35.875257 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. Jul 20 22:12:35.877168 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:35.878791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Returning 404 to user: Instance 28c5e28e-b134-4485-ba56-409ae4258b63 could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:12:35.878791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-c0db9d34-d457-42ec-8ea8-667fa439da9c tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63" status: 404 len: 111 microversion: 2.1 time: 0.029883 Jul 20 22:12:35.878791 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 603/1260] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:35 2022] GET /compute/v2.1/servers/28c5e28e-b134-4485-ba56-409ae4258b63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:36.592165 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:36.592730 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.compute.api [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124151) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:36.599197 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:36.599638 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:36.600384 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:36.600809 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG oslo_concurrency.lockutils [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:36.614375 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.wsgi [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] HTTP exception thrown: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Request method failure captured: Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: request: DELETE /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc HTTP/1.1 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept: application/json Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Accept-Encoding: identity Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Connection: close Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Length: 0 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Content-Type: application/json Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Host: 10.222.0.86 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Openstack-System-Scope: None Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: User-Agent: python-urllib3/1.26.9 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Auth-Token: gAAAAABi2Hw5W2EZIyWaIbwfWAbxvRjMMaWglfNik3Y4WHKhsYOfMS4YZlLpBvK3pd7KWlTFcjtubXqxzLIJG6bvGRG1bbJ6qcc2oUsi-zA34kHhyjRZw6beXNav8TVaeqfoTiT0VeOEujekbWzso4yKByQIdakDA7YELp1VFzfjJbXhGFb_fFo Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Id: None Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Domain-Name: None Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Identity-Status: Confirmed Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Is-Admin-Project: True Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Id: default Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Domain-Name: Default Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Project-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Role: reader,member Jul 20 22:12:36.616019 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Roles: reader,member Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_edb66957f3a041039ae0d6ac39476549", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}] Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Id: default Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Domain-Name: Default Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Id: 40553bbbf7af408dbffb8da1beab1062 Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: X-User-Name: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: method: > Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: exception: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.617692 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: action_args: {'id': 'e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc'} Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:12:36.618548 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.620661 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.622403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Returning 404 to user: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. {{(pid=124151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:12:36.622403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-664f59e2-675a-4167-8b19-66cf24174879 tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 404 len: 111 microversion: 2.1 time: 0.029824 Jul 20 22:12:36.622403 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 658/1261] 10.222.0.86 () {58 vars in 1238 bytes} [Wed Jul 20 22:12:36 2022] DELETE /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:36.626181 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '>' {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:36.626821 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.compute.api [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] [instance: e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc] Fetching instance by UUID {{(pid=124150) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:12:36.632840 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:36.633288 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:36.634040 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:12:36.634471 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG oslo_concurrency.lockutils [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Lock "cb646c5e-8d70-4d2e-9cfe-402204556fef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:12:36.647624 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.wsgi [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] HTTP exception thrown: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Request method failure captured: Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: request: GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc HTTP/1.1 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept: application/json Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Accept-Encoding: identity Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Connection: close Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Length: 0 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Content-Type: application/json Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Host: 10.222.0.86 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Openstack-System-Scope: None Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: User-Agent: python-urllib3/1.26.9 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Auth-Token: gAAAAABi2Hw5W2EZIyWaIbwfWAbxvRjMMaWglfNik3Y4WHKhsYOfMS4YZlLpBvK3pd7KWlTFcjtubXqxzLIJG6bvGRG1bbJ6qcc2oUsi-zA34kHhyjRZw6beXNav8TVaeqfoTiT0VeOEujekbWzso4yKByQIdakDA7YELp1VFzfjJbXhGFb_fFo Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Id: None Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Domain-Name: None Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Identity-Status: Confirmed Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Is-Admin-Project: True Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Id: default Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Domain-Name: Default Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Project-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Role: reader,member Jul 20 22:12:36.649119 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Roles: reader,member Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:8080/v1/AUTH_edb66957f3a041039ae0d6ac39476549", "adminURL": "http://10.222.0.86:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/edb66957f3a041039ae0d6ac39476549"}]}] Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Id: edb66957f3a041039ae0d6ac39476549 Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830997736 Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Id: default Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Domain-Name: Default Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Id: 40553bbbf7af408dbffb8da1beab1062 Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: X-User-Name: tempest-TestVolumeBootPattern-1830997736-project Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: method: > Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: exception: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.651649 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: action_args: {'id': 'e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc'} Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: {{(pid=124150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:12:36.652622 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. Jul 20 22:12:36.654227 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: ERROR nova.api.openstack.wsgi Jul 20 22:12:36.655750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: DEBUG nova.api.openstack.wsgi [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Returning 404 to user: Instance e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc could not be found. {{(pid=124150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:12:36.655750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO nova.api.openstack.requestlog [None req-ea98831d-ad0b-4a1d-afef-565b75c111ca tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc" status: 404 len: 111 microversion: 2.1 time: 0.028326 Jul 20 22:12:36.655750 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: [pid: 124150|app: 0|req: 604/1262] 10.222.0.86 () {58 vars in 1235 bytes} [Wed Jul 20 22:12:36 2022] GET /compute/v2.1/servers/e6bb91b9-0a38-4339-b8c7-05eaf5eaf6cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:37.935009 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: DEBUG nova.api.openstack.wsgi [None req-d0a27cbf-c1cf-47da-8d47-e008a82d188e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] Calling method '.version_select at 0x7f6aba406670>' {{(pid=124151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:12:37.967260 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO nova.api.openstack.requestlog [None req-d0a27cbf-c1cf-47da-8d47-e008a82d188e tempest-TestVolumeBootPattern-1830997736 tempest-TestVolumeBootPattern-1830997736-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1241537853" status: 202 len: 0 microversion: 2.1 time: 0.025527 Jul 20 22:12:37.967877 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: [pid: 124151|app: 0|req: 659/1263] 10.222.0.86 () {58 vars in 1262 bytes} [Wed Jul 20 22:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1241537853 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:13:01.380707 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:13:01.381425 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:14:27.675864 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:14:27.676469 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:14:39.976516 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:14:39.977249 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:16:21.388888 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:16:21.389427 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:17:47.684932 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:17:47.685578 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:17:59.985375 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:17:59.986129 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:18:02.288595 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:18:02.289132 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:18:19.636336 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:18:19.636909 dv-cinder-849690-5-iscsi devstack@n-api.service[124150]: Wed Jul 20 22:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:18:21.988639 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:18:21.991626 dv-cinder-849690-5-iscsi devstack@n-api.service[124151]: Wed Jul 20 22:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!